Nov 15 15:38:02 user nova-compute[75095]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75095) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75095) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75095) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 15:38:02 user nova-compute[75095]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:38:02 user nova-compute[75095]: INFO nova.virt.driver [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 15:38:02 user nova-compute[75095]: INFO nova.compute.provider_config [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Acquiring lock "singleton_lock" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Acquired lock "singleton_lock" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Releasing lock "singleton_lock" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Full set of CONF: {{(pid=75095) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ******************************************************************************** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Configuration options gathered from: {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ================================================================================ {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 15:38:02 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] allow_resize_to_same_host      = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] arq_binding_timeout            = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] backdoor_port                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] backdoor_socket                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] block_device_allocate_retries  = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] block_device_allocate_retries_interval = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cert                           = self.pem {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute_monitors               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] config_dir                     = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] config_drive_format            = iso9660 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] config_source                  = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] console_host                   = user {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] control_exchange               = nova {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cpu_allocation_ratio           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] daemon                         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] debug                          = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_access_ip_network_name = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_availability_zone      = nova {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_ephemeral_format       = ext4 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_green_pool_size        = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] default_schedule_zone          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] disk_allocation_ratio          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] enable_new_services            = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] enabled_ssl_apis               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] flat_injected                  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] force_config_drive             = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] force_raw_images               = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] graceful_shutdown_timeout      = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] heal_instance_info_cache_interval = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] host                           = user {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_build_timeout         = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_delete_interval       = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_name_template         = instance-%08x {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_usage_audit           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_usage_audit_period    = month {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] internal_service_availability_zone = internal {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] key                            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] live_migration_retry_count     = 30 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_config_append              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_dir                        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_file                       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_options                    = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_rotate_interval            = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_rotate_interval_type       = days {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] log_rotation_type              = none {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] long_rpc_timeout               = 1800 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_concurrent_builds          = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_concurrent_live_migrations = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_concurrent_snapshots       = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_local_block_devices        = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_logfile_count              = 30 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] max_logfile_size_mb            = 200 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] maximum_instance_delete_attempts = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metadata_listen                = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metadata_listen_port           = 8775 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metadata_workers               = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] migrate_max_retries            = -1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] mkisofs_cmd                    = genisoimage {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] my_ip                          = 10.0.0.210 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] network_allocate_retries       = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] osapi_compute_listen_port      = 8774 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] osapi_compute_unique_server_name_scope =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] osapi_compute_workers          = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] password_length                = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] periodic_enable                = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] periodic_fuzzy_delay           = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] pointer_model                  = ps2mouse {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] preallocate_images             = none {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] publish_errors                 = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] pybasedir                      = /opt/stack/nova {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ram_allocation_ratio           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rate_limit_burst               = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rate_limit_except_level        = CRITICAL {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rate_limit_interval            = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reboot_timeout                 = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reclaim_instance_interval      = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] record                         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reimage_timeout_per_gb         = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] report_interval                = 120 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rescue_timeout                 = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reserved_host_cpus             = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reserved_host_disk_mb          = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reserved_host_memory_mb        = 512 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] reserved_huge_pages            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] resize_confirm_window          = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] resize_fs_using_block_device   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] resume_guests_state_on_host_boot = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rpc_response_timeout           = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] run_external_periodic_tasks    = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] running_deleted_instance_action = reap {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] running_deleted_instance_timeout = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler_instance_sync_interval = 120 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_down_time              = 720 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] servicegroup_driver            = db {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] shelved_offload_time           = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] shelved_poll_interval          = 3600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] shutdown_timeout               = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] source_is_ipv6                 = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ssl_only                       = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] state_path                     = /opt/stack/data/nova {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] sync_power_state_interval      = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] sync_power_state_pool_size     = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] syslog_log_facility            = LOG_USER {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] tempdir                        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] timeout_nbd                    = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] transport_url                  = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] update_resources_interval      = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_cow_images                 = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_eventlog                   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_journal                    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_json                       = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_rootwrap_daemon            = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_stderr                     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] use_syslog                     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vcpu_pin_set                   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plugging_is_fatal          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plugging_timeout           = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] virt_mkfs                      = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] volume_usage_poll_interval     = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] watch_log_file                 = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] web                            = /usr/share/spice-html5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_concurrency.disable_process_locking = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.auth_strategy              = keystone {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.compute_link_prefix        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.dhcp_domain                = novalocal {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.enable_instance_password   = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.glance_link_prefix         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.instance_list_per_project_cells = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.list_records_by_skipping_down_cells = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.local_metadata_per_cell    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.max_limit                  = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.metadata_cache_expiration  = 15 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.neutron_default_tenant_id  = default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.use_forwarded_for          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.use_neutron_default_nets   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_dynamic_targets = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_jsonfile_path   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.backend_argument         = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.config_prefix            = cache.oslo {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.dead_timeout             = 60.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.debug_cache_backend      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.enable_retry_client      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.enable_socket_keepalive  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.enabled                  = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.expiration_time          = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.hashclient_retry_attempts = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_dead_retry      = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_password        =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_sasl_enabled    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.memcache_username        =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.proxies                  = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.retry_attempts           = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.retry_delay              = 0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.socket_keepalive_count   = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.socket_keepalive_idle    = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.socket_keepalive_interval = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.tls_allowed_ciphers      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.tls_cafile               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.tls_certfile             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.tls_enabled              = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cache.tls_keyfile              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.auth_section            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.auth_type               = password {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.cafile                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.certfile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.collect_timing          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.cross_az_attach         = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.debug                   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.endpoint_template       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.http_retries            = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.insecure                = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.keyfile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.os_region_name          = RegionOne {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.split_loggers           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cinder.timeout                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.cpu_dedicated_set      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.cpu_shared_set         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.image_type_exclude_list = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.resource_provider_association_refresh = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.shutdown_retry_interval = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] conductor.workers              = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] console.allowed_origins        = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] console.ssl_ciphers            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] console.ssl_minimum_version    = default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] consoleauth.token_ttl          = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.cafile                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.certfile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.collect_timing          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.connect_retries         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.connect_retry_delay     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.endpoint_override       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.insecure                = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.keyfile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.max_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.min_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.region_name             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.service_name            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.service_type            = accelerator {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.split_loggers           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.status_code_retries     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.timeout                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] cyborg.version                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.backend               = sqlalchemy {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.connection            = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.connection_debug      = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.connection_parameters =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.connection_recycle_time = 3600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.connection_trace      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.db_inc_retry_interval = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.db_max_retries        = 20 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.db_max_retry_interval = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.db_retry_interval     = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.max_overflow          = 50 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.max_pool_size         = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.max_retries           = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.mysql_wsrep_sync_wait = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.pool_timeout          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.retry_interval        = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.slave_connection      = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] database.sqlite_synchronous    = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.backend           = sqlalchemy {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.connection        = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.connection_debug  = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.connection_parameters =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.connection_recycle_time = 3600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.connection_trace  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.db_inc_retry_interval = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.db_max_retries    = 20 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.db_max_retry_interval = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.db_retry_interval = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.max_overflow      = 50 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.max_pool_size     = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.max_retries       = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.pool_timeout      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.retry_interval    = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.slave_connection  = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] api_database.sqlite_synchronous = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] devices.enabled_mdev_types     = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ephemeral_storage_encryption.enabled = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.api_servers             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.cafile                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.certfile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.collect_timing          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.connect_retries         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.connect_retry_delay     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.debug                   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.default_trusted_certificate_ids = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.enable_certificate_validation = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.enable_rbd_download     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.endpoint_override       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.insecure                = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.keyfile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.max_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.min_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.num_retries             = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.rbd_ceph_conf           =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.rbd_connect_timeout     = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.rbd_pool                =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.rbd_user                =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.region_name             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.service_name            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.service_type            = image {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.split_loggers           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.status_code_retries     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.timeout                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.verify_glance_signatures = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] glance.version                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] guestfs.debug                  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.config_drive_cdrom      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.config_drive_inject_password = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.enable_remotefx         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.instances_path_share    =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.limit_cpu_features      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.use_multipath_io        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.vswitch_name            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] mks.enabled                    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.manager_interval   = 2400 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.precache_concurrency = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.remove_unused_base_images = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] image_cache.subdirectory_name  = _base {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.api_max_retries         = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.api_retry_interval      = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.auth_section            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.auth_type               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.cafile                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.certfile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.collect_timing          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.conductor_group         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.connect_retries         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.connect_retry_delay     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.endpoint_override       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.insecure                = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.keyfile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.max_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.min_version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.peer_list               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.region_name             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.serial_console_state_timeout = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.service_name            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.service_type            = baremetal {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.split_loggers           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.status_code_retries     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.timeout                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ironic.version                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] key_manager.fixed_key          = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.barbican_api_version  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.barbican_endpoint     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.barbican_endpoint_type = public {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.barbican_region_name  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.cafile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.certfile              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.collect_timing        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.insecure              = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.keyfile               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.number_of_retries     = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.retry_delay           = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.send_service_user_token = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.split_loggers         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.timeout               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.verify_ssl            = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican.verify_ssl_path       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.auth_section = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.auth_type = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.cafile   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.certfile = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.collect_timing = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.insecure = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.keyfile  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.split_loggers = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] barbican_service_user.timeout  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.approle_role_id          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.approle_secret_id        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.cafile                   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.certfile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.collect_timing           = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.insecure                 = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.keyfile                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.kv_mountpoint            = secret {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.kv_path                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.kv_version               = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.namespace                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.root_token_id            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.split_loggers            = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.ssl_ca_crt_file          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.timeout                  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.use_ssl                  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.auth_section          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.auth_type             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.cafile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.certfile              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.collect_timing        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.connect_retries       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.connect_retry_delay   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.endpoint_override     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.insecure              = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.keyfile               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.max_version           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.min_version           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.region_name           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.service_name          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.service_type          = identity {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.split_loggers         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.status_code_retries   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.timeout               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] keystone.version               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.connection_uri         =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_mode               = custom {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: WARNING oslo_config.cfg [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_power_governor_high = performance {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_power_management   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.device_detach_attempts = 8 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.device_detach_timeout  = 20 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.disk_cachemodes        = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.disk_prefix            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.enabled_perf_events    = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.file_backed_memory     = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.gid_maps               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.hw_disk_discard        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.hw_machine_type        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_rbd_pool        = rbd {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_type            = default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.images_volume_group    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.inject_key             = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.inject_partition       = -2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.inject_password        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.iscsi_iface            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.iser_use_multipath     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_downtime = 500 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_inbound_addr = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_scheme  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_timeout_action = abort {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_tunnelled = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: WARNING oslo_config.cfg [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 15:38:03 user nova-compute[75095]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 15:38:03 user nova-compute[75095]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 15:38:03 user nova-compute[75095]: and ``live_migration_inbound_addr`` respectively.
Nov 15 15:38:03 user nova-compute[75095]: ).  Its value may be silently ignored in the future.
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.live_migration_with_native_tls = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.max_queues             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.nfs_mount_options      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_pcie_ports         = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.pmem_namespaces        = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.quobyte_client_cfg     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rbd_secret_uuid        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rbd_user               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rescue_image_id        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rescue_kernel_id       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.rx_queue_size          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.smbfs_mount_options    =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.snapshot_compression   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.snapshot_image_format  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.sparse_logical_volumes = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.swtpm_enabled          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.swtpm_group            = tss {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.swtpm_user             = tss {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.sysinfo_serial         = unique {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.tb_cache_size          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.tx_queue_size          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.uid_maps               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.use_virtio_for_bridges = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.virt_type              = kvm {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.volume_clear           = zero {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.volume_clear_size      = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.volume_use_multipath   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_cache_path   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.auth_section           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.auth_type              = password {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.cafile                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.certfile               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.collect_timing         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.connect_retries        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.connect_retry_delay    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.default_floating_pool  = public {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.endpoint_override      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.extension_sync_interval = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.http_retries           = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.insecure               = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.keyfile                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.max_version            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.min_version            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.ovs_bridge             = br-int {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.physnets               = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.region_name            = RegionOne {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.service_metadata_proxy = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.service_name           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.service_type           = network {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.split_loggers          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.status_code_retries    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.timeout                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] neutron.version                = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] notifications.bdms_in_notifications = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] notifications.default_level    = INFO {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] notifications.notification_format = unversioned {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] notifications.notify_on_state_change = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] pci.alias                      = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] pci.device_spec                = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] pci.report_in_placement        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.auth_section         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.auth_type            = password {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.cafile               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.certfile             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.collect_timing       = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.connect_retries      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.connect_retry_delay  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.default_domain_id    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.default_domain_name  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.domain_id            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.domain_name          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.endpoint_override    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.insecure             = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.keyfile              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.max_version          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.min_version          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.password             = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.project_domain_id    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.project_domain_name  = Default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.project_id           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.project_name         = service {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.region_name          = RegionOne {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.service_name         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.service_type         = placement {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.split_loggers        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.status_code_retries  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.system_scope         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.timeout              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.trust_id             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.user_domain_id       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.user_domain_name     = Default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.user_id              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.username             = placement {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] placement.version              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.cores                    = 20 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.count_usage_from_placement = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.injected_file_content_bytes = 10240 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.injected_file_path_length = 255 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.injected_files           = 5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.instances                = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.key_pairs                = 100 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.metadata_items           = 128 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.ram                      = 51200 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.recheck_quota            = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.server_group_members     = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] quota.server_groups            = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rdp.enabled                    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.image_metadata_prefilter = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.max_attempts         = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.max_placement_results = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] scheduler.workers              = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.host_subset_size = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.isolated_hosts = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.isolated_images = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.pci_in_placement = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.track_instance_changes = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metrics.required               = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metrics.weight_multiplier      = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] metrics.weight_setting         = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.enabled         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.port_range      = 10000:20000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] serial_console.serialproxy_port = 6083 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.auth_section      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.auth_type         = password {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.cafile            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.certfile          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.collect_timing    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.insecure          = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.keyfile           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.send_service_user_token = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.split_loggers     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] service_user.timeout           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.agent_enabled            = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.enabled                  = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.html5proxy_port          = 6082 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.image_compression        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.jpeg_compression         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.playback_compression     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.server_listen            = 127.0.0.1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.streaming_mode           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] spice.zlib_compression         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] upgrade_levels.baseapi         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] upgrade_levels.cert            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] upgrade_levels.compute         = auto {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] upgrade_levels.conductor       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] upgrade_levels.scheduler       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.cafile = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.certfile = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.insecure = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vendordata_dynamic_auth.timeout = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.api_retry_count         = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.ca_file                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.cache_prefix            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.cluster_name            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.connection_pool_size    = 10 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.console_delay_seconds   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.datastore_regex         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.host_ip                 = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.host_password           = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.host_port               = 443 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.host_username           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.insecure                = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.integration_bridge      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.maximum_objects         = 100 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.pbm_default_policy      = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.pbm_enabled             = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.pbm_wsdl_location       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.serial_port_proxy_uri   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.serial_port_service_uri = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.task_poll_interval      = 0.5 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.use_linked_clone        = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.vnc_keymap              = en-us {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.vnc_port                = 5900 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vmware.vnc_port_total          = 10000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.auth_schemes               = ['none'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.enabled                    = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.novncproxy_port            = 6080 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.vencrypt_ca_certs          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.vencrypt_client_cert       = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vnc.vencrypt_client_key        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.disable_rootwrap   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.enable_numa_live_migration = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.libvirt_disable_apic = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.client_socket_timeout     = 900 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.default_pool_size         = 1000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.keep_alive                = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.max_header_line           = 16384 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.ssl_ca_file               = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.ssl_cert_file             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.ssl_key_file              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.tcp_keepidle              = 600 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] zvm.ca_file                    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] zvm.cloud_connector_url        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] zvm.reachable_timeout          = 300 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.enforce_new_defaults = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.enforce_scope      = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.policy_default_rule = default {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.connection_string     = messaging:// {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.enabled               = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.es_doc_type           = notification {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.es_scroll_size        = 10000 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.es_scroll_time        = 2m {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.filter_error_trace    = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.hmac_keys             = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.sentinel_service_name = mymaster {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.socket_timeout        = 0.1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.trace_requests        = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler.trace_sqlalchemy      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler_jaeger.process_tags   = {} {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler_jaeger.service_name_prefix = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] profiler_otlp.service_name_prefix = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] remote_debug.host              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] remote_debug.port              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_notifications.retry = -1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.auth_section        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.auth_type           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.cafile              = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.certfile            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.collect_timing      = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.connect_retries     = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.connect_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.endpoint_id         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.endpoint_override   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.insecure            = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.keyfile             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.max_version         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.min_version         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.region_name         = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.service_name        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.service_type        = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.split_loggers       = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.status_code_retries = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.status_code_retry_delay = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.timeout             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.valid_interfaces    = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_limit.version             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_reports.file_event_handler = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] oslo_reports.log_dir           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.group  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] vif_plug_ovs_privileged.user   = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.isolate_vif         = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] os_brick.lock_path             = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.capabilities   = [21] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.group          = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.helper_command = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] privsep_osbrick.user           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.group           = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.helper_command  = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] nova_sys_admin.user            = None {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG oslo_service.service [None req-1b3f8488-1d30-453d-ad3a-3ad9476ce951 None None] ******************************************************************************** {{(pid=75095) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 15:38:03 user nova-compute[75095]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Connecting to libvirt: qemu:///system {{(pid=75095) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5964146f80> {{(pid=75095) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 15:38:03 user nova-compute[75095]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 15:38:03 user nova-compute[75095]: WARNING nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5964146f80> {{(pid=75095) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Starting native event thread {{(pid=75095) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Starting green dispatch thread {{(pid=75095) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Starting connection event dispatch thread {{(pid=75095) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 15:38:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Connection event '1' reason 'None'
Nov 15 15:38:03 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 15:38:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.mount [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Initialising _HostMountState generation 0 {{(pid=75095) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 15:38:10 user nova-compute[75095]: INFO nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host capabilities <capabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <host>
Nov 15 15:38:10 user nova-compute[75095]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 15:38:10 user nova-compute[75095]:     <cpu>
Nov 15 15:38:10 user nova-compute[75095]:       <arch>x86_64</arch>
Nov 15 15:38:10 user nova-compute[75095]:       <model>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <microcode version='1070'/>
Nov 15 15:38:10 user nova-compute[75095]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='osxsave'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='invtsc'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='rsba'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 15:38:10 user nova-compute[75095]:       <pages unit='KiB' size='4'/>
Nov 15 15:38:10 user nova-compute[75095]:       <pages unit='KiB' size='2048'/>
Nov 15 15:38:10 user nova-compute[75095]:     </cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <power_management>
Nov 15 15:38:10 user nova-compute[75095]:       <suspend_mem/>
Nov 15 15:38:10 user nova-compute[75095]:       <suspend_disk/>
Nov 15 15:38:10 user nova-compute[75095]:       <suspend_hybrid/>
Nov 15 15:38:10 user nova-compute[75095]:     </power_management>
Nov 15 15:38:10 user nova-compute[75095]:     <iommu support='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <migration_features>
Nov 15 15:38:10 user nova-compute[75095]:       <live/>
Nov 15 15:38:10 user nova-compute[75095]:       <uri_transports>
Nov 15 15:38:10 user nova-compute[75095]:         <uri_transport>tcp</uri_transport>
Nov 15 15:38:10 user nova-compute[75095]:         <uri_transport>rdma</uri_transport>
Nov 15 15:38:10 user nova-compute[75095]:       </uri_transports>
Nov 15 15:38:10 user nova-compute[75095]:     </migration_features>
Nov 15 15:38:10 user nova-compute[75095]:     <topology>
Nov 15 15:38:10 user nova-compute[75095]:       <cells num='2'>
Nov 15 15:38:10 user nova-compute[75095]:         <cell id='0'>
Nov 15 15:38:10 user nova-compute[75095]:           <memory unit='KiB'>8140672</memory>
Nov 15 15:38:10 user nova-compute[75095]:           <pages unit='KiB' size='4'>2035168</pages>
Nov 15 15:38:10 user nova-compute[75095]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 15:38:10 user nova-compute[75095]:           <distances>
Nov 15 15:38:10 user nova-compute[75095]:             <sibling id='0' value='10'/>
Nov 15 15:38:10 user nova-compute[75095]:             <sibling id='1' value='20'/>
Nov 15 15:38:10 user nova-compute[75095]:           </distances>
Nov 15 15:38:10 user nova-compute[75095]:           <cpus num='6'>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 15:38:10 user nova-compute[75095]:           </cpus>
Nov 15 15:38:10 user nova-compute[75095]:         </cell>
Nov 15 15:38:10 user nova-compute[75095]:         <cell id='1'>
Nov 15 15:38:10 user nova-compute[75095]:           <memory unit='KiB'>8254992</memory>
Nov 15 15:38:10 user nova-compute[75095]:           <pages unit='KiB' size='4'>2063748</pages>
Nov 15 15:38:10 user nova-compute[75095]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 15:38:10 user nova-compute[75095]:           <distances>
Nov 15 15:38:10 user nova-compute[75095]:             <sibling id='0' value='20'/>
Nov 15 15:38:10 user nova-compute[75095]:             <sibling id='1' value='10'/>
Nov 15 15:38:10 user nova-compute[75095]:           </distances>
Nov 15 15:38:10 user nova-compute[75095]:           <cpus num='6'>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 15:38:10 user nova-compute[75095]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 15:38:10 user nova-compute[75095]:           </cpus>
Nov 15 15:38:10 user nova-compute[75095]:         </cell>
Nov 15 15:38:10 user nova-compute[75095]:       </cells>
Nov 15 15:38:10 user nova-compute[75095]:     </topology>
Nov 15 15:38:10 user nova-compute[75095]:     <cache>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 15:38:10 user nova-compute[75095]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 15:38:10 user nova-compute[75095]:     </cache>
Nov 15 15:38:10 user nova-compute[75095]:     <secmodel>
Nov 15 15:38:10 user nova-compute[75095]:       <model>apparmor</model>
Nov 15 15:38:10 user nova-compute[75095]:       <doi>0</doi>
Nov 15 15:38:10 user nova-compute[75095]:     </secmodel>
Nov 15 15:38:10 user nova-compute[75095]:     <secmodel>
Nov 15 15:38:10 user nova-compute[75095]:       <model>dac</model>
Nov 15 15:38:10 user nova-compute[75095]:       <doi>0</doi>
Nov 15 15:38:10 user nova-compute[75095]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 15:38:10 user nova-compute[75095]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 15:38:10 user nova-compute[75095]:     </secmodel>
Nov 15 15:38:10 user nova-compute[75095]:   </host>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='alpha'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>clipper</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='armv6l'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>spitz</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>nuri</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>kzm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>z2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>tosa</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n810</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>terrier</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>midway</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>microbit</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>verdex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>highbank</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>akita</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>connex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>collie</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='armv7l'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>spitz</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>nuri</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>kzm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>z2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>tosa</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n810</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>terrier</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>midway</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>microbit</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>verdex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>highbank</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>akita</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>connex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>collie</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='aarch64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>spitz</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>nuri</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>kzm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>z2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>tosa</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n810</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>n800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>terrier</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>midway</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>microbit</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>verdex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>highbank</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>akita</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>connex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>collie</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <acpi default='on' toggle='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='cris'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='i686'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>isapc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>microvm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='kvm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <pae/>
Nov 15 15:38:10 user nova-compute[75095]:       <nonpae/>
Nov 15 15:38:10 user nova-compute[75095]:       <acpi default='on' toggle='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:       <apic default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='m68k'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>an5206</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>q800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='microblaze'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='microblazeel'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='mips'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>malta</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='mipsel'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>malta</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='mips64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>malta</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>pica61</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>magnum</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='mips64el'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>malta</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>pica61</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>magnum</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='16'>boston</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='ppc'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mac99</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>40p</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>taihu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='ppc64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>taihu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>40p</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mac99</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='ppc64le'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>taihu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>40p</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>mac99</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='riscv32'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='8'>spike</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='8'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='riscv64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='8'>spike</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='8'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='s390x'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='sh4'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>shix</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>r2d</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='sh4eb'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>shix</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>r2d</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='sparc'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>LX</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='sparc64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>niagara</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='x86_64'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>64</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='1'>isapc</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>microvm</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='kvm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <acpi default='on' toggle='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:       <apic default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='xtensa'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>sim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>kc705</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ml605</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx200</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx60</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]:   <guest>
Nov 15 15:38:10 user nova-compute[75095]:     <os_type>hvm</os_type>
Nov 15 15:38:10 user nova-compute[75095]:     <arch name='xtensaeb'>
Nov 15 15:38:10 user nova-compute[75095]:       <wordsize>32</wordsize>
Nov 15 15:38:10 user nova-compute[75095]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='4'>sim</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>kc705</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ml605</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>virt</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx200</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>lx60</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 15:38:10 user nova-compute[75095]:       <domain type='qemu'/>
Nov 15 15:38:10 user nova-compute[75095]:     </arch>
Nov 15 15:38:10 user nova-compute[75095]:     <features>
Nov 15 15:38:10 user nova-compute[75095]:       <cpuselection/>
Nov 15 15:38:10 user nova-compute[75095]:       <deviceboot/>
Nov 15 15:38:10 user nova-compute[75095]:       <disksnapshot default='on' toggle='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     </features>
Nov 15 15:38:10 user nova-compute[75095]:   </guest>
Nov 15 15:38:10 user nova-compute[75095]: </capabilities>
Nov 15 15:38:10 user nova-compute[75095]: 
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-q35-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>i686</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='288'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'/>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='lm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-i440fx-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>i686</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='255'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'/>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='lm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ide</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-i440fx-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>i686</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='255'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'/>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='lm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ide</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-q35-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>i686</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='288'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'/>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='lm'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-q35-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>x86_64</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='288'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>efi</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='invtsc'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='rsba'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-i440fx-6.2</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>x86_64</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='255'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>efi</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='invtsc'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='rsba'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ide</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-i440fx-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>x86_64</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='255'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>efi</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='invtsc'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='rsba'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ide</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 15:38:10 user nova-compute[75095]: <domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 15:38:10 user nova-compute[75095]:   <domain>kvm</domain>
Nov 15 15:38:10 user nova-compute[75095]:   <machine>pc-q35-jammy</machine>
Nov 15 15:38:10 user nova-compute[75095]:   <arch>x86_64</arch>
Nov 15 15:38:10 user nova-compute[75095]:   <vcpu max='288'/>
Nov 15 15:38:10 user nova-compute[75095]:   <iothreads supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:   <os supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='firmware'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>efi</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:     <loader supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>rom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pflash</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='readonly'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='secure'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>yes</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>no</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </loader>
Nov 15 15:38:10 user nova-compute[75095]:   </os>
Nov 15 15:38:10 user nova-compute[75095]:   <cpu>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-passthrough' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='hostPassthroughMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='maximum' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='maximumMigratable'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>on</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>off</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='host-model' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <vendor>Intel</vendor>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ss'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='vmx'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pcid'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='hypervisor'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arat'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='umip'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='md-clear'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='invtsc'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibpb'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='ibrs'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-stibp'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='rsba'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='erms'/>
Nov 15 15:38:10 user nova-compute[75095]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:     <mode name='custom' supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>qemu64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>qemu32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>phenom</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>pentium</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>n270</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm64</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>kvm32</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>coreduo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>core2duo</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>athlon</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Westmere</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Snowridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Skylake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>SandyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Penryn</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G5</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G4</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G3</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Opteron_G2</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Opteron_G1</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>IvyBridge</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Icelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Haswell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Rome</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-Milan</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>EPYC</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Dhyana</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cooperlake</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>Conroe</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='no'>Broadwell</model>
Nov 15 15:38:10 user nova-compute[75095]:       <model usable='yes'>486</model>
Nov 15 15:38:10 user nova-compute[75095]:     </mode>
Nov 15 15:38:10 user nova-compute[75095]:   </cpu>
Nov 15 15:38:10 user nova-compute[75095]:   <memoryBacking supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:     <enum name='sourceType'>
Nov 15 15:38:10 user nova-compute[75095]:       <value>file</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>anonymous</value>
Nov 15 15:38:10 user nova-compute[75095]:       <value>memfd</value>
Nov 15 15:38:10 user nova-compute[75095]:     </enum>
Nov 15 15:38:10 user nova-compute[75095]:   </memoryBacking>
Nov 15 15:38:10 user nova-compute[75095]:   <devices>
Nov 15 15:38:10 user nova-compute[75095]:     <disk supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='diskDevice'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>disk</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cdrom</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>floppy</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>lun</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='bus'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>fdc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sata</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </disk>
Nov 15 15:38:10 user nova-compute[75095]:     <graphics supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='type'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>sdl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vnc</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>spice</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egl-headless</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </graphics>
Nov 15 15:38:10 user nova-compute[75095]:     <video supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='modelType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>cirrus</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>vmvga</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>qxl</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>none</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>bochs</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>ramfb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </video>
Nov 15 15:38:10 user nova-compute[75095]:     <hostdev supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='mode'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>subsystem</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='startupPolicy'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>default</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>mandatory</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>requisite</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>optional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='subsysType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>usb</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>pci</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>scsi</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='capsType'/>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='pciBackend'/>
Nov 15 15:38:10 user nova-compute[75095]:     </hostdev>
Nov 15 15:38:10 user nova-compute[75095]:     <rng supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtio-non-transitional</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>random</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>egd</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>builtin</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </rng>
Nov 15 15:38:10 user nova-compute[75095]:     <filesystem supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='driverType'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>path</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>handle</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>virtiofs</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </filesystem>
Nov 15 15:38:10 user nova-compute[75095]:     <tpm supported='yes'>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='model'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-tis</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>tpm-crb</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:       <enum name='backendModel'>
Nov 15 15:38:10 user nova-compute[75095]:         <value>passthrough</value>
Nov 15 15:38:10 user nova-compute[75095]:         <value>emulator</value>
Nov 15 15:38:10 user nova-compute[75095]:       </enum>
Nov 15 15:38:10 user nova-compute[75095]:     </tpm>
Nov 15 15:38:10 user nova-compute[75095]:   </devices>
Nov 15 15:38:10 user nova-compute[75095]:   <features>
Nov 15 15:38:10 user nova-compute[75095]:     <gic supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:     <vmcoreinfo supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <genid supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backingStoreInput supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <backup supported='yes'/>
Nov 15 15:38:10 user nova-compute[75095]:     <sev supported='no'/>
Nov 15 15:38:10 user nova-compute[75095]:   </features>
Nov 15 15:38:10 user nova-compute[75095]: </domainCapabilities>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75095) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75095) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Checking secure boot support for host arch (x86_64) {{(pid=75095) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 15:38:10 user nova-compute[75095]: INFO nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Secure Boot support detected
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] cpu compare xml: <cpu match="exact">
Nov 15 15:38:10 user nova-compute[75095]:   <model>Nehalem</model>
Nov 15 15:38:10 user nova-compute[75095]: </cpu>
Nov 15 15:38:10 user nova-compute[75095]:  {{(pid=75095) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 15:38:10 user nova-compute[75095]: INFO nova.virt.node [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Generated node identity 7d24b3e3-8fc8-4e80-977a-b249dde4779c
Nov 15 15:38:10 user nova-compute[75095]: INFO nova.virt.node [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Wrote node identity 7d24b3e3-8fc8-4e80-977a-b249dde4779c to /opt/stack/data/nova/compute_id
Nov 15 15:38:10 user nova-compute[75095]: WARNING nova.compute.manager [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Compute nodes ['7d24b3e3-8fc8-4e80-977a-b249dde4779c'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 15:38:10 user nova-compute[75095]: INFO nova.compute.manager [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 15:38:10 user nova-compute[75095]: WARNING nova.compute.manager [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 15:38:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:38:10 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:38:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:38:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Hypervisor/Node resource view: name=user free_ram=10961MB free_disk=25.452205657958984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:38:11 user nova-compute[75095]: WARNING nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] No compute node record for user:7d24b3e3-8fc8-4e80-977a-b249dde4779c: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7d24b3e3-8fc8-4e80-977a-b249dde4779c could not be found.
Nov 15 15:38:11 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Compute node record created for user:user with uuid: 7d24b3e3-8fc8-4e80-977a-b249dde4779c
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:38:11 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] [req-9ba59b9f-1b90-4d60-9922-70b9ee732c23] Created resource provider record via placement API for resource provider with UUID 7d24b3e3-8fc8-4e80-977a-b249dde4779c and name user.
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75095) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 15:38:11 user nova-compute[75095]: INFO nova.virt.libvirt.host [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] kernel doesn't support AMD SEV
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Libvirt baseline CPU <cpu>
Nov 15 15:38:11 user nova-compute[75095]:   <arch>x86_64</arch>
Nov 15 15:38:11 user nova-compute[75095]:   <model>Nehalem</model>
Nov 15 15:38:11 user nova-compute[75095]:   <vendor>Intel</vendor>
Nov 15 15:38:11 user nova-compute[75095]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 15:38:11 user nova-compute[75095]: </cpu>
Nov 15 15:38:11 user nova-compute[75095]:  {{(pid=75095) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Updated inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Updating resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c generation from 0 to 1 during operation: update_inventory {{(pid=75095) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Updating resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c generation from 1 to 2 during operation: update_traits {{(pid=75095) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.service [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Creating RPC server for service compute {{(pid=75095) start /opt/stack/nova/nova/service.py:182}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.service [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] Join ServiceGroup membership for this service compute {{(pid=75095) start /opt/stack/nova/nova/service.py:199}}
Nov 15 15:38:11 user nova-compute[75095]: DEBUG nova.servicegroup.drivers.db [None req-ab6d0648-f601-4423-b2e8-990500d54745 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75095) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 15:38:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:38:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:39:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:39:03 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:39:03 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=10392MB free_disk=25.356033325195312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:39:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.146s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:40:04 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:40:04 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:40:04 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=10331MB free_disk=25.42041015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:40:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:40:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:41:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:41:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:41:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:41:04 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:41:04 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:41:04 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=10328MB free_disk=25.172897338867188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:41:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:41:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:42:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:42:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:42:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:06 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:42:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9634MB free_disk=25.192699432373047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:42:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:14 user nova-compute[75095]: INFO nova.compute.claims [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Claim successful on node user
Nov 15 15:42:14 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Creating image(s)
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "/opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "/opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "/opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.policy [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06d872503684414b89a28d9fea2f4ee9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7f3f18923d3425e8db038b5d83dddbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.virt.images [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] 42c1c869-d893-4140-8d14-8f5bfccef902 was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:42:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.part /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.part /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.converted" returned: 0 in 0.349s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003.converted --force-share --output=json" returned: 0 in 0.166s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.122s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:16 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpxyeasdl9/privsep.sock']
Nov 15 15:42:16 user sudo[84398]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpxyeasdl9/privsep.sock
Nov 15 15:42:16 user sudo[84398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:16 user nova-compute[75095]: INFO nova.compute.claims [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Claim successful on node user
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.106s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:16 user nova-compute[75095]: INFO nova.compute.claims [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Claim successful on node user
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Creating image(s)
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.policy [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f344bdd39e54736a7b7c7388bb8dbdb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2038e0b00a9d431eaadfaac074eaee2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Creating image(s)
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:17 user nova-compute[75095]: DEBUG nova.policy [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975ca4994eb74b6bbf541bb308b148f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c587b1467441ceb091ece4e973408e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:17 user sudo[84398]: pam_unix(sudo:session): session closed for user root
Nov 15 15:42:17 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Spawned new privsep daemon via rootwrap
Nov 15 15:42:17 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 15:42:17 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 15:42:17 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 15:42:17 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84403
Nov 15 15:42:17 user nova-compute[75095]: WARNING oslo_privsep.priv_context [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] privsep daemon already running
Nov 15 15:42:17 user nova-compute[75095]: WARNING oslo_privsep.priv_context [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] privsep daemon already running
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.164s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.165s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Successfully created port: daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.200s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk 1073741824" returned: 0 in 0.052s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.252s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk 1073741824" returned: 0 in 0.046s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.513s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Cannot resize image /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Ensure instance console log exists: /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.242s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk 1073741824" returned: 0 in 0.056s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Cannot resize image /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Ensure instance console log exists: /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.232s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Cannot resize image /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Ensure instance console log exists: /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Successfully created port: b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:20 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Successfully created port: 7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:21 user nova-compute[75095]: INFO nova.compute.claims [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Claim successful on node user
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Successfully updated port: daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquired lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:21 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:21 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Creating image(s)
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-changed-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Refreshing instance network info cache due to event network-changed-daebd6f1-15b4-4b4d-9082-f4628e874aa3. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] Acquiring lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.policy [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1b18bf4b448346beaea19f95e59ea778', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed810aaa216455bb359448237bb716b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk 1073741824" returned: 0 in 0.044s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Successfully updated port: 7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Cannot resize image /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Ensure instance console log exists: /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updating instance_info_cache with network_info: [{"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Successfully updated port: b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Releasing lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Instance network_info: |[{"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] Acquired lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Refreshing network info cache for port daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Start _get_guest_xml network_info=[{"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing instance network info cache due to event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1420653092',display_name='tempest-DeleteServersTestJSON-server-1420653092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1420653092',id=1,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7f3f18923d3425e8db038b5d83dddbc',ramdisk_id='',reservation_id='r-bp77w98v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-246956719',owner_user_name='tempest-DeleteServersTestJSON-246956719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:15Z,user_data=None,user_id='06d872503684414b89a28d9fea2f4ee9',uuid=82599a5d-33c4-4d13-ba6d-56cd211083ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converting VIF {"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lazy-loading 'pci_devices' on Instance uuid 82599a5d-33c4-4d13-ba6d-56cd211083ef {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:23 user nova-compute[75095]:   <uuid>82599a5d-33c4-4d13-ba6d-56cd211083ef</uuid>
Nov 15 15:42:23 user nova-compute[75095]:   <name>instance-00000001</name>
Nov 15 15:42:23 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:23 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:23 user nova-compute[75095]:   <metadata>
Nov 15 15:42:23 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:23 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:name>tempest-DeleteServersTestJSON-server-1420653092</nova:name>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:23</nova:creationTime>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:23 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:user uuid="06d872503684414b89a28d9fea2f4ee9">tempest-DeleteServersTestJSON-246956719-project-member</nova:user>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:project uuid="c7f3f18923d3425e8db038b5d83dddbc">tempest-DeleteServersTestJSON-246956719</nova:project>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:port uuid="daebd6f1-15b4-4b4d-9082-f4628e874aa3">
Nov 15 15:42:23 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 15:42:23 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:23 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:23 user nova-compute[75095]:   </metadata>
Nov 15 15:42:23 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:23 user nova-compute[75095]:     <system>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="serial">82599a5d-33c4-4d13-ba6d-56cd211083ef</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="uuid">82599a5d-33c4-4d13-ba6d-56cd211083ef</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:23 user nova-compute[75095]:     </system>
Nov 15 15:42:23 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:23 user nova-compute[75095]:   <os>
Nov 15 15:42:23 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:23 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:23 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:23 user nova-compute[75095]:   </os>
Nov 15 15:42:23 user nova-compute[75095]:   <features>
Nov 15 15:42:23 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:23 user nova-compute[75095]:     <apic/>
Nov 15 15:42:23 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:23 user nova-compute[75095]:   </features>
Nov 15 15:42:23 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:23 user nova-compute[75095]:   </clock>
Nov 15 15:42:23 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:23 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:23 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:23 user nova-compute[75095]:   </cpu>
Nov 15 15:42:23 user nova-compute[75095]:   <devices>
Nov 15 15:42:23 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:23 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:23 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk"/>
Nov 15 15:42:23 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:     </disk>
Nov 15 15:42:23 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:23 user nova-compute[75095]:       <mac address="fa:16:3e:c5:f3:fb"/>
Nov 15 15:42:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:23 user nova-compute[75095]:       <target dev="tapdaebd6f1-15"/>
Nov 15 15:42:23 user nova-compute[75095]:     </interface>
Nov 15 15:42:23 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:23 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/console.log" append="off"/>
Nov 15 15:42:23 user nova-compute[75095]:     </serial>
Nov 15 15:42:23 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:23 user nova-compute[75095]:     <video>
Nov 15 15:42:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:     </video>
Nov 15 15:42:23 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:23 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:23 user nova-compute[75095]:     </rng>
Nov 15 15:42:23 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:23 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:23 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:23 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:23 user nova-compute[75095]:   </devices>
Nov 15 15:42:23 user nova-compute[75095]: </domain>
Nov 15 15:42:23 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1420653092',display_name='tempest-DeleteServersTestJSON-server-1420653092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1420653092',id=1,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7f3f18923d3425e8db038b5d83dddbc',ramdisk_id='',reservation_id='r-bp77w98v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-246956719',owner_user_name='tempest-DeleteServersTestJSON-246956719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:15Z,user_data=None,user_id='06d872503684414b89a28d9fea2f4ee9',uuid=82599a5d-33c4-4d13-ba6d-56cd211083ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converting VIF {"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG os_vif [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Created schema index Interface.name {{(pid=75095) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Created schema index Port.name {{(pid=75095) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Created schema index Bridge.name {{(pid=75095) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [POLLOUT] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92518311-bc39-58d8-9145-beceed19eaf6', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:23 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpm_3rv6oz/privsep.sock']
Nov 15 15:42:23 user sudo[84506]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpm_3rv6oz/privsep.sock
Nov 15 15:42:23 user sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Instance network_info: |[{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Start _get_guest_xml network_info=[{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1684390480',display_name='tempest-ServerActionsTestOtherA-server-1684390480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1684390480',id=3,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-x08ajgqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=6bff7d80-06e7-4219-a602-6c6be1fef714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:23 user nova-compute[75095]:   <uuid>6bff7d80-06e7-4219-a602-6c6be1fef714</uuid>
Nov 15 15:42:23 user nova-compute[75095]:   <name>instance-00000003</name>
Nov 15 15:42:23 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:23 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:23 user nova-compute[75095]:   <metadata>
Nov 15 15:42:23 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:23 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherA-server-1684390480</nova:name>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:23</nova:creationTime>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:23 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:user uuid="975ca4994eb74b6bbf541bb308b148f1">tempest-ServerActionsTestOtherA-440053215-project-member</nova:user>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:project uuid="18c587b1467441ceb091ece4e973408e">tempest-ServerActionsTestOtherA-440053215</nova:project>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:23 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:23 user nova-compute[75095]:         <nova:port uuid="7be16d0d-57a4-4ee4-922b-e4837f781f65">
Nov 15 15:42:23 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 15:42:23 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:23 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:23 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:23 user nova-compute[75095]:   </metadata>
Nov 15 15:42:23 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:23 user nova-compute[75095]:     <system>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="serial">6bff7d80-06e7-4219-a602-6c6be1fef714</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="uuid">6bff7d80-06e7-4219-a602-6c6be1fef714</entry>
Nov 15 15:42:23 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:23 user nova-compute[75095]:     </system>
Nov 15 15:42:23 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:23 user nova-compute[75095]:   <os>
Nov 15 15:42:23 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:23 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:23 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:23 user nova-compute[75095]:   </os>
Nov 15 15:42:23 user nova-compute[75095]:   <features>
Nov 15 15:42:23 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:23 user nova-compute[75095]:     <apic/>
Nov 15 15:42:23 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:23 user nova-compute[75095]:   </features>
Nov 15 15:42:23 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:23 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:23 user nova-compute[75095]:   </clock>
Nov 15 15:42:23 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:23 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:23 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:23 user nova-compute[75095]:   </cpu>
Nov 15 15:42:23 user nova-compute[75095]:   <devices>
Nov 15 15:42:23 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:23 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:23 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk"/>
Nov 15 15:42:23 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:     </disk>
Nov 15 15:42:23 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:23 user nova-compute[75095]:       <mac address="fa:16:3e:77:e0:f7"/>
Nov 15 15:42:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:23 user nova-compute[75095]:       <target dev="tap7be16d0d-57"/>
Nov 15 15:42:23 user nova-compute[75095]:     </interface>
Nov 15 15:42:23 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:23 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/console.log" append="off"/>
Nov 15 15:42:23 user nova-compute[75095]:     </serial>
Nov 15 15:42:23 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:23 user nova-compute[75095]:     <video>
Nov 15 15:42:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:23 user nova-compute[75095]:     </video>
Nov 15 15:42:23 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:23 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:23 user nova-compute[75095]:     </rng>
Nov 15 15:42:23 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:23 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:23 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:23 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:23 user nova-compute[75095]:   </devices>
Nov 15 15:42:23 user nova-compute[75095]: </domain>
Nov 15 15:42:23 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1684390480',display_name='tempest-ServerActionsTestOtherA-server-1684390480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1684390480',id=3,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-x08ajgqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=6bff7d80-06e7-4219-a602-6c6be1fef714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG os_vif [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '240bad43-8f52-5750-8edc-36e54fcfa379', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Successfully created port: b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-changed-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Refreshing instance network info cache due to event network-changed-b02c9c61-0809-40d0-be33-1d8b596c67b2. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance network_info: |[{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Refreshing network info cache for port b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start _get_guest_xml network_info=[{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:24 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:24 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'pci_devices' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:24 user nova-compute[75095]:   <uuid>7447d0b9-3152-49ab-8576-994810c20e29</uuid>
Nov 15 15:42:24 user nova-compute[75095]:   <name>instance-00000002</name>
Nov 15 15:42:24 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:24 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:24 user nova-compute[75095]:   <metadata>
Nov 15 15:42:24 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:24 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherB-server-67125786</nova:name>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:24</nova:creationTime>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:24 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:24 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:user uuid="3f344bdd39e54736a7b7c7388bb8dbdb">tempest-ServerActionsTestOtherB-1639554019-project-member</nova:user>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:project uuid="2038e0b00a9d431eaadfaac074eaee2d">tempest-ServerActionsTestOtherB-1639554019</nova:project>
Nov 15 15:42:24 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:24 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:24 user nova-compute[75095]:         <nova:port uuid="b02c9c61-0809-40d0-be33-1d8b596c67b2">
Nov 15 15:42:24 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:42:24 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:24 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:24 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:24 user nova-compute[75095]:   </metadata>
Nov 15 15:42:24 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:24 user nova-compute[75095]:     <system>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="serial">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="uuid">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:42:24 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:24 user nova-compute[75095]:     </system>
Nov 15 15:42:24 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:24 user nova-compute[75095]:   <os>
Nov 15 15:42:24 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:24 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:24 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:24 user nova-compute[75095]:   </os>
Nov 15 15:42:24 user nova-compute[75095]:   <features>
Nov 15 15:42:24 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:24 user nova-compute[75095]:     <apic/>
Nov 15 15:42:24 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:24 user nova-compute[75095]:   </features>
Nov 15 15:42:24 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:24 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:24 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:24 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:24 user nova-compute[75095]:   </clock>
Nov 15 15:42:24 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:24 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:24 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:24 user nova-compute[75095]:   </cpu>
Nov 15 15:42:24 user nova-compute[75095]:   <devices>
Nov 15 15:42:24 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:24 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:24 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk"/>
Nov 15 15:42:24 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:24 user nova-compute[75095]:     </disk>
Nov 15 15:42:24 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:24 user nova-compute[75095]:       <mac address="fa:16:3e:56:ec:23"/>
Nov 15 15:42:24 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:24 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:24 user nova-compute[75095]:       <target dev="tapb02c9c61-08"/>
Nov 15 15:42:24 user nova-compute[75095]:     </interface>
Nov 15 15:42:24 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:24 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/console.log" append="off"/>
Nov 15 15:42:24 user nova-compute[75095]:     </serial>
Nov 15 15:42:24 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:24 user nova-compute[75095]:     <video>
Nov 15 15:42:24 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:24 user nova-compute[75095]:     </video>
Nov 15 15:42:24 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:24 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:24 user nova-compute[75095]:     </rng>
Nov 15 15:42:24 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:24 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:24 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:24 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:24 user nova-compute[75095]:   </devices>
Nov 15 15:42:24 user nova-compute[75095]: </domain>
Nov 15 15:42:24 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG os_vif [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12b4c361-3a4f-5a90-9f69-e06add412966', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated VIF entry in instance network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33e734fe-34dc-43ab-9750-bb955626c5ba req-bac7e7b3-d47f-4a96-9fd5-d6b33fe57370 service nova] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updated VIF entry in instance network info cache for port daebd6f1-15b4-4b4d-9082-f4628e874aa3. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updating instance_info_cache with network_info: [{"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1affe5cc-060d-4138-8ee6-af67f463186d req-5cf7cf7e-389c-42d7-8b8d-ad2ac0134023 service nova] Releasing lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:24 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Successfully updated port: b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:25 user sudo[84506]: pam_unix(sudo:session): session closed for user root
Nov 15 15:42:25 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Spawned new privsep daemon via rootwrap
Nov 15 15:42:25 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 15:42:25 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 15:42:25 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 15:42:25 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84519
Nov 15 15:42:25 user nova-compute[75095]: WARNING oslo_privsep.priv_context [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] privsep daemon already running
Nov 15 15:42:25 user nova-compute[75095]: WARNING oslo_privsep.priv_context [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] privsep daemon already running
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing instance network info cache due to event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance network_info: |[{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start _get_guest_xml network_info=[{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:25 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:25 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updated VIF entry in instance network info cache for port b02c9c61-0809-40d0-be33-1d8b596c67b2. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1967741566',display_name='tempest-ServerStableDeviceRescueTest-server-1967741566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1967741566',id=4,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBUOIfdbDk/brXXiylka2/btdkrjY3diz7DKadf13/ZIXcRbgTpOTtE06UY9cDwKBRHgGAHt69/VENIJfjafbfdolZpGClTyfIfX148jIcxUAMRahY1njiu0GNtx6ilXg==',key_name='tempest-keypair-112033150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ed810aaa216455bb359448237bb716b',ramdisk_id='',reservation_id='r-m4a5wyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1847037719',owner_user_name='tempest-ServerStableDeviceRescueTest-1847037719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b18bf4b448346beaea19f95e59ea778',uuid=f8acca60-e3f3-412e-bf0f-023ed2943bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converting VIF {"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.objects.instance [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'pci_devices' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b527881-a98d-4c4c-88a1-bfc115539e11 req-14b0a7cf-0b6b-4926-9b93-2687810ef44d service nova] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:25 user nova-compute[75095]:   <uuid>f8acca60-e3f3-412e-bf0f-023ed2943bfc</uuid>
Nov 15 15:42:25 user nova-compute[75095]:   <name>instance-00000004</name>
Nov 15 15:42:25 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:25 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:25 user nova-compute[75095]:   <metadata>
Nov 15 15:42:25 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:25 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1967741566</nova:name>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:25</nova:creationTime>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:25 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:25 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:user uuid="1b18bf4b448346beaea19f95e59ea778">tempest-ServerStableDeviceRescueTest-1847037719-project-member</nova:user>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:project uuid="5ed810aaa216455bb359448237bb716b">tempest-ServerStableDeviceRescueTest-1847037719</nova:project>
Nov 15 15:42:25 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:25 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:25 user nova-compute[75095]:         <nova:port uuid="b8c2c859-3325-4d81-a66f-fb84a4115cfd">
Nov 15 15:42:25 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 15:42:25 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:25 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:25 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:25 user nova-compute[75095]:   </metadata>
Nov 15 15:42:25 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:25 user nova-compute[75095]:     <system>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="serial">f8acca60-e3f3-412e-bf0f-023ed2943bfc</entry>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="uuid">f8acca60-e3f3-412e-bf0f-023ed2943bfc</entry>
Nov 15 15:42:25 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:25 user nova-compute[75095]:     </system>
Nov 15 15:42:25 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:25 user nova-compute[75095]:   <os>
Nov 15 15:42:25 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:25 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:25 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:25 user nova-compute[75095]:   </os>
Nov 15 15:42:25 user nova-compute[75095]:   <features>
Nov 15 15:42:25 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:25 user nova-compute[75095]:     <apic/>
Nov 15 15:42:25 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:25 user nova-compute[75095]:   </features>
Nov 15 15:42:25 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:25 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:25 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:25 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:25 user nova-compute[75095]:   </clock>
Nov 15 15:42:25 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:25 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:25 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:25 user nova-compute[75095]:   </cpu>
Nov 15 15:42:25 user nova-compute[75095]:   <devices>
Nov 15 15:42:25 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:25 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:25 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk"/>
Nov 15 15:42:25 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:25 user nova-compute[75095]:     </disk>
Nov 15 15:42:25 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:25 user nova-compute[75095]:       <mac address="fa:16:3e:e5:60:f6"/>
Nov 15 15:42:25 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:25 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:25 user nova-compute[75095]:       <target dev="tapb8c2c859-33"/>
Nov 15 15:42:25 user nova-compute[75095]:     </interface>
Nov 15 15:42:25 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:25 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/console.log" append="off"/>
Nov 15 15:42:25 user nova-compute[75095]:     </serial>
Nov 15 15:42:25 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:25 user nova-compute[75095]:     <video>
Nov 15 15:42:25 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:25 user nova-compute[75095]:     </video>
Nov 15 15:42:25 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:25 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:25 user nova-compute[75095]:     </rng>
Nov 15 15:42:25 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:25 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:25 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:25 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:25 user nova-compute[75095]:   </devices>
Nov 15 15:42:25 user nova-compute[75095]: </domain>
Nov 15 15:42:25 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1967741566',display_name='tempest-ServerStableDeviceRescueTest-server-1967741566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1967741566',id=4,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBUOIfdbDk/brXXiylka2/btdkrjY3diz7DKadf13/ZIXcRbgTpOTtE06UY9cDwKBRHgGAHt69/VENIJfjafbfdolZpGClTyfIfX148jIcxUAMRahY1njiu0GNtx6ilXg==',key_name='tempest-keypair-112033150',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ed810aaa216455bb359448237bb716b',ramdisk_id='',reservation_id='r-m4a5wyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1847037719',owner_user_name='tempest-ServerStableDeviceRescueTest-1847037719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b18bf4b448346beaea19f95e59ea778',uuid=f8acca60-e3f3-412e-bf0f-023ed2943bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converting VIF {"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG os_vif [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14c82b1d-f3d1-5367-97ea-667a53807cf5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaebd6f1-15, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaebd6f1-15, col_values=(('qos', UUID('36a3d816-777d-4e01-b550-cfab4a67c8fc')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaebd6f1-15, col_values=(('external_ids', {'iface-id': 'daebd6f1-15b4-4b4d-9082-f4628e874aa3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:f3:fb', 'vm-uuid': '82599a5d-33c4-4d13-ba6d-56cd211083ef'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: INFO os_vif [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15')
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be16d0d-57, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7be16d0d-57, col_values=(('qos', UUID('148acfab-99ec-4a2b-9ad0-39728427158c')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7be16d0d-57, col_values=(('external_ids', {'iface-id': '7be16d0d-57a4-4ee4-922b-e4837f781f65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:e0:f7', 'vm-uuid': '6bff7d80-06e7-4219-a602-6c6be1fef714'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: INFO os_vif [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57')
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb02c9c61-08, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb02c9c61-08, col_values=(('qos', UUID('ae0bdd5c-67c2-4b5d-8ef4-846f19505776')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb02c9c61-08, col_values=(('external_ids', {'iface-id': 'b02c9c61-0809-40d0-be33-1d8b596c67b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ec:23', 'vm-uuid': '7447d0b9-3152-49ab-8576-994810c20e29'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] No VIF found with MAC fa:16:3e:c5:f3:fb, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: INFO os_vif [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8c2c859-33, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8c2c859-33, col_values=(('qos', UUID('d619decd-3dd3-4859-a998-5c2fcc1bceb0')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8c2c859-33, col_values=(('external_ids', {'iface-id': 'b8c2c859-3325-4d81-a66f-fb84a4115cfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:60:f6', 'vm-uuid': 'f8acca60-e3f3-412e-bf0f-023ed2943bfc'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:26 user nova-compute[75095]: INFO os_vif [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33')
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:77:e0:f7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No VIF found with MAC fa:16:3e:56:ec:23, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No VIF found with MAC fa:16:3e:e5:60:f6, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.network.neutron [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updated VIF entry in instance network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG nova.network.neutron [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9f323035-babd-485e-8caa-30da67650437 req-db346685-5596-4976-a6f2-004f70bbb63a service nova] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:32 user nova-compute[75095]: INFO nova.compute.claims [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Claim successful on node user
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.policy [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6bba667990d94f6c8608ca147b130224', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76dcdfe283a64fc08915a530582cf44c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Creating image(s)
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.virt.images [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] 79edd7ff-4e14-4a3c-b02c-83af2b99a9db was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.part /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Successfully created port: 79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Instance spawned successfully.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance spawned successfully.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance spawned successfully.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Instance spawned successfully.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.part /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.converted" returned: 0 in 0.708s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Took 17.34 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Took 12.74 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Took 17.56 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Took 19.48 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:34 user nova-compute[75095]: INFO nova.compute.manager [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Took 13.59 seconds to build instance.
Nov 15 15:42:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8.converted --force-share --output=json" returned: 0 in 0.283s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.721s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10ad165c-fa2d-436b-bed1-5f6baa577b8f tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.785s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:35 user nova-compute[75095]: INFO nova.compute.manager [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Took 18.31 seconds to build instance.
Nov 15 15:42:35 user nova-compute[75095]: INFO nova.compute.manager [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Took 20.67 seconds to build instance.
Nov 15 15:42:35 user nova-compute[75095]: INFO nova.compute.manager [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Took 18.52 seconds to build instance.
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json" returned: 0 in 0.375s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e202a35-4fdf-4c44-98b9-b11fb594cc00 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.741s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a3ea79-b457-4902-998f-adfbb52f7a2d tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.327s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e02ac820-fd7e-47d9-9a4d-45c4a1972036 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.120s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json" returned: 0 in 0.226s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8,backing_fmt=raw /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8,backing_fmt=raw /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk 1073741824" returned: 0 in 0.071s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 --force-share --output=json" returned: 0 in 0.226s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Checking if we can resize image /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Cannot resize image /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Successfully updated port: 79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquired lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-changed-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Refreshing instance network info cache due to event network-changed-79e10ded-1e90-48a9-8849-a5580ff15a8d. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] Acquiring lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updating instance_info_cache with network_info: [{"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Releasing lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Instance network_info: |[{"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] Acquired lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Refreshing network info cache for port 79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Start _get_guest_xml network_info=[{"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:42:24Z,direct_url=<?>,disk_format='qcow2',id=79edd7ff-4e14-4a3c-b02c-83af2b99a9db,min_disk=0,min_ram=0,name='',owner='2888af6051544ca9b4c8897454a6774c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:42:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '79edd7ff-4e14-4a3c-b02c-83af2b99a9db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:42:24Z,direct_url=<?>,disk_format='qcow2',id=79edd7ff-4e14-4a3c-b02c-83af2b99a9db,min_disk=0,min_ram=0,name='',owner='2888af6051544ca9b4c8897454a6774c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:42:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-969747710',display_name='tempest-AttachSCSIVolumeTestJSON-server-969747710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-969747710',id=5,image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2bZiQSX7zrhHgqI/o/BhkHljg8JFNdz9O+sxZEvdO+/ISjtHeHANwYeqjxEhkxOjUwrVrwdPA9KSm0+a4/7G0ToB0aHNXRSrZ7BqJG6SUHd5XpLa8tS9iLdOAvz9YzpA==',key_name='tempest-keypair-1802452636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76dcdfe283a64fc08915a530582cf44c',ramdisk_id='',reservation_id='r-xsgggr3b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-432443087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-432443087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bba667990d94f6c8608ca147b130224',uuid=205e57b3-4d57-43b8-9fac-484a8511e1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converting VIF {"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lazy-loading 'pci_devices' on Instance uuid 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:37 user nova-compute[75095]:   <uuid>205e57b3-4d57-43b8-9fac-484a8511e1e8</uuid>
Nov 15 15:42:37 user nova-compute[75095]:   <name>instance-00000005</name>
Nov 15 15:42:37 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:37 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:37 user nova-compute[75095]:   <metadata>
Nov 15 15:42:37 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:37 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-969747710</nova:name>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:37</nova:creationTime>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:37 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:37 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:user uuid="6bba667990d94f6c8608ca147b130224">tempest-AttachSCSIVolumeTestJSON-432443087-project-member</nova:user>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:project uuid="76dcdfe283a64fc08915a530582cf44c">tempest-AttachSCSIVolumeTestJSON-432443087</nova:project>
Nov 15 15:42:37 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:root type="image" uuid="79edd7ff-4e14-4a3c-b02c-83af2b99a9db"/>
Nov 15 15:42:37 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:37 user nova-compute[75095]:         <nova:port uuid="79e10ded-1e90-48a9-8849-a5580ff15a8d">
Nov 15 15:42:37 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:42:37 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:37 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:37 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:37 user nova-compute[75095]:   </metadata>
Nov 15 15:42:37 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:37 user nova-compute[75095]:     <system>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="serial">205e57b3-4d57-43b8-9fac-484a8511e1e8</entry>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="uuid">205e57b3-4d57-43b8-9fac-484a8511e1e8</entry>
Nov 15 15:42:37 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:37 user nova-compute[75095]:     </system>
Nov 15 15:42:37 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:37 user nova-compute[75095]:   <os>
Nov 15 15:42:37 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:37 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:37 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:37 user nova-compute[75095]:   </os>
Nov 15 15:42:37 user nova-compute[75095]:   <features>
Nov 15 15:42:37 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:37 user nova-compute[75095]:     <apic/>
Nov 15 15:42:37 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:37 user nova-compute[75095]:   </features>
Nov 15 15:42:37 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:37 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:37 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:37 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:37 user nova-compute[75095]:   </clock>
Nov 15 15:42:37 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:37 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:37 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:37 user nova-compute[75095]:   </cpu>
Nov 15 15:42:37 user nova-compute[75095]:   <devices>
Nov 15 15:42:37 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:37 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:37 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk"/>
Nov 15 15:42:37 user nova-compute[75095]:       <target dev="sda" bus="scsi"/>
Nov 15 15:42:37 user nova-compute[75095]:       <address type="drive" controller="0" unit="0"/>
Nov 15 15:42:37 user nova-compute[75095]:     </disk>
Nov 15 15:42:37 user nova-compute[75095]:     <disk type="file" device="cdrom">
Nov 15 15:42:37 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 15:42:37 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.config"/>
Nov 15 15:42:37 user nova-compute[75095]:       <target dev="sdb" bus="scsi"/>
Nov 15 15:42:37 user nova-compute[75095]:       <address type="drive" controller="0" unit="1"/>
Nov 15 15:42:37 user nova-compute[75095]:     </disk>
Nov 15 15:42:37 user nova-compute[75095]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 15:42:37 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:37 user nova-compute[75095]:       <mac address="fa:16:3e:bb:92:8f"/>
Nov 15 15:42:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:37 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:37 user nova-compute[75095]:       <target dev="tap79e10ded-1e"/>
Nov 15 15:42:37 user nova-compute[75095]:     </interface>
Nov 15 15:42:37 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:37 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/console.log" append="off"/>
Nov 15 15:42:37 user nova-compute[75095]:     </serial>
Nov 15 15:42:37 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:37 user nova-compute[75095]:     <video>
Nov 15 15:42:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:37 user nova-compute[75095]:     </video>
Nov 15 15:42:37 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:37 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:37 user nova-compute[75095]:     </rng>
Nov 15 15:42:37 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:37 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:37 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:37 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:37 user nova-compute[75095]:   </devices>
Nov 15 15:42:37 user nova-compute[75095]: </domain>
Nov 15 15:42:37 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-969747710',display_name='tempest-AttachSCSIVolumeTestJSON-server-969747710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-969747710',id=5,image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2bZiQSX7zrhHgqI/o/BhkHljg8JFNdz9O+sxZEvdO+/ISjtHeHANwYeqjxEhkxOjUwrVrwdPA9KSm0+a4/7G0ToB0aHNXRSrZ7BqJG6SUHd5XpLa8tS9iLdOAvz9YzpA==',key_name='tempest-keypair-1802452636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76dcdfe283a64fc08915a530582cf44c',ramdisk_id='',reservation_id='r-xsgggr3b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-432443087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-432443087-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bba667990d94f6c8608ca147b130224',uuid=205e57b3-4d57-43b8-9fac-484a8511e1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converting VIF {"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG os_vif [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4bcf4d09-7c78-59cb-81ef-70dbf52222cf', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79e10ded-1e, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79e10ded-1e, col_values=(('qos', UUID('d40a9b0e-f843-4fc3-ad96-e556c6dddd79')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79e10ded-1e, col_values=(('external_ids', {'iface-id': '79e10ded-1e90-48a9-8849-a5580ff15a8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:92:8f', 'vm-uuid': '205e57b3-4d57-43b8-9fac-484a8511e1e8'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:37 user nova-compute[75095]: INFO os_vif [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e')
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No BDM found with device name sda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No VIF found with MAC fa:16:3e:bb:92:8f, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Using config drive
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Creating config drive at /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.config
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppgmcmx9k {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppgmcmx9k" returned: 0 in 0.068s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updated VIF entry in instance network info cache for port 79e10ded-1e90-48a9-8849-a5580ff15a8d. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updating instance_info_cache with network_info: [{"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec55c135-d515-4585-a805-cb7541d79bda req-6bbd950c-d860-47b8-bf94-aafbc7d92d87 service nova] Releasing lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:38 user nova-compute[75095]: WARNING nova.compute.manager [req-179efa35-4ce3-4f20-9342-59a6c711cfb8 req-334df815-f226-4fbf-bbba-459c6570dcb6 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state None.
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] No waiting events found dispatching network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:40 user nova-compute[75095]: WARNING nova.compute.manager [req-e68ab87d-ea0d-4620-9969-7242834c50e9 req-0c11a333-4a05-4e65-836c-141ce0b611ae service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received unexpected event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 for instance with vm_state active and task_state None.
Nov 15 15:42:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:40 user nova-compute[75095]: WARNING nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state None.
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] No waiting events found dispatching network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:40 user nova-compute[75095]: WARNING nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received unexpected event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 for instance with vm_state active and task_state None.
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] No waiting events found dispatching network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:40 user nova-compute[75095]: WARNING nova.compute.manager [req-89e6ac97-2edc-4d1f-9a7d-6b7c438fa8b5 req-44ea1828-d204-44bd-8a47-4e09c35eb672 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received unexpected event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 for instance with vm_state active and task_state None.
Nov 15 15:42:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:41 user nova-compute[75095]: INFO nova.compute.claims [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Claim successful on node user
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:41 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.policy [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffb7f652d1ea433a92ffcccf0b93f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb8bb4f0ef14c929f8ba8c60295b2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Creating image(s)
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] No waiting events found dispatching network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:42 user nova-compute[75095]: WARNING nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received unexpected event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 for instance with vm_state active and task_state None.
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:42 user nova-compute[75095]: WARNING nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state None.
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:42 user nova-compute[75095]: WARNING nova.compute.manager [req-7c883023-cd48-4ab2-8579-8d5e36b5a63c req-5ac7cf4b-0b86-4248-adbe-4a9ed8279e20 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state None.
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.213s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk 1073741824" returned: 0 in 0.129s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.244s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:43 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Instance spawned successfully.
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Successfully created port: 6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Cannot resize image /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Ensure instance console log exists: /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:43 user nova-compute[75095]: INFO nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Took 10.19 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:43 user nova-compute[75095]: INFO nova.compute.manager [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Took 11.19 seconds to build instance.
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdef1eb5-ea57-4330-840c-9f8038aa5a52 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.321s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Successfully updated port: 6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:44 user nova-compute[75095]: INFO nova.compute.claims [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Claim successful on node user
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-changed-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing instance network info cache due to event network-changed-6114f792-1084-4110-a522-3e22b0991f20. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Instance network_info: |[{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing network info cache for port 6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Start _get_guest_xml network_info=[{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:44 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:44 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'pci_devices' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:44 user nova-compute[75095]:   <uuid>82cf5365-8116-43dc-adcf-58006b301b6b</uuid>
Nov 15 15:42:44 user nova-compute[75095]:   <name>instance-00000006</name>
Nov 15 15:42:44 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:44 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:44 user nova-compute[75095]:   <metadata>
Nov 15 15:42:44 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:44 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:44</nova:creationTime>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:44 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:44 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:42:44 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:44 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:44 user nova-compute[75095]:         <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:42:44 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:42:44 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:44 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:44 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:44 user nova-compute[75095]:   </metadata>
Nov 15 15:42:44 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:44 user nova-compute[75095]:     <system>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="serial">82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="uuid">82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:42:44 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:44 user nova-compute[75095]:     </system>
Nov 15 15:42:44 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:44 user nova-compute[75095]:   <os>
Nov 15 15:42:44 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:44 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:44 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:44 user nova-compute[75095]:   </os>
Nov 15 15:42:44 user nova-compute[75095]:   <features>
Nov 15 15:42:44 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:44 user nova-compute[75095]:     <apic/>
Nov 15 15:42:44 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:44 user nova-compute[75095]:   </features>
Nov 15 15:42:44 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:44 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:44 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:44 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:44 user nova-compute[75095]:   </clock>
Nov 15 15:42:44 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:44 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:44 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:44 user nova-compute[75095]:   </cpu>
Nov 15 15:42:44 user nova-compute[75095]:   <devices>
Nov 15 15:42:44 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:44 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:44 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk"/>
Nov 15 15:42:44 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:44 user nova-compute[75095]:     </disk>
Nov 15 15:42:44 user nova-compute[75095]:     <disk type="file" device="cdrom">
Nov 15 15:42:44 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 15:42:44 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config"/>
Nov 15 15:42:44 user nova-compute[75095]:       <target dev="hda" bus="ide"/>
Nov 15 15:42:44 user nova-compute[75095]:     </disk>
Nov 15 15:42:44 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:44 user nova-compute[75095]:       <mac address="fa:16:3e:36:9f:cd"/>
Nov 15 15:42:44 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:44 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:44 user nova-compute[75095]:       <target dev="tap6114f792-10"/>
Nov 15 15:42:44 user nova-compute[75095]:     </interface>
Nov 15 15:42:44 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:44 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log" append="off"/>
Nov 15 15:42:44 user nova-compute[75095]:     </serial>
Nov 15 15:42:44 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:44 user nova-compute[75095]:     <video>
Nov 15 15:42:44 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:44 user nova-compute[75095]:     </video>
Nov 15 15:42:44 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:44 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:44 user nova-compute[75095]:     </rng>
Nov 15 15:42:44 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:44 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:44 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:44 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:44 user nova-compute[75095]:   </devices>
Nov 15 15:42:44 user nova-compute[75095]: </domain>
Nov 15 15:42:44 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG os_vif [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5e3a460-4813-5305-a9f5-8f3455d45faa', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6114f792-10, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6114f792-10, col_values=(('qos', UUID('f915cc0f-d756-490e-be02-11b2fc766652')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6114f792-10, col_values=(('external_ids', {'iface-id': '6114f792-1084-4110-a522-3e22b0991f20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:9f:cd', 'vm-uuid': '82cf5365-8116-43dc-adcf-58006b301b6b'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:44 user nova-compute[75095]: INFO os_vif [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10')
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name hda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No VIF found with MAC fa:16:3e:36:9f:cd, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Using config drive
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.policy [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd535b1490c7149748f5e1e8abe972363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0125799450d4db5804d3c14dac0f383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Creating image(s)
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "/opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "/opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "/opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Creating config drive at /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpffji711z {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.network.neutron [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updated VIF entry in instance network info cache for port 6114f792-1084-4110-a522-3e22b0991f20. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.network.neutron [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.265s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpffji711z" returned: 0 in 0.094s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e45761d4-a395-4e73-8035-c862ba2743b9 req-18992921-2570-46eb-92a1-c481ab03822a service nova] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.262s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk 1073741824" returned: 0 in 0.061s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Checking if we can resize image /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Cannot resize image /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Ensure instance console log exists: /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] No waiting events found dispatching network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:46 user nova-compute[75095]: WARNING nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received unexpected event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d for instance with vm_state active and task_state None.
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] No waiting events found dispatching network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:46 user nova-compute[75095]: WARNING nova.compute.manager [req-29bc0f50-7fdb-45b9-8137-cf01bb719e1f req-0ccf78da-8f09-4a70-a9e1-c4358d7e0616 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received unexpected event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d for instance with vm_state active and task_state None.
Nov 15 15:42:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Successfully created port: d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:47 user nova-compute[75095]: INFO nova.compute.claims [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Claim successful on node user
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:48 user nova-compute[75095]: INFO nova.virt.block_device [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Booting with volume 9c7f5944-102a-48ee-a60e-976f2b73357d at /dev/vda
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.policy [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '967d134fe5cb41aaa8181e8372724dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bae3e7bf05d46c48aab837a23446af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG os_brick.utils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:42:48 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp9delq_fz/privsep.sock']
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Successfully updated port: d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:48 user sudo[85623]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp9delq_fz/privsep.sock
Nov 15 15:42:48 user sudo[85623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 15:42:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquired lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-changed-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Refreshing instance network info cache due to event network-changed-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] Acquiring lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updating instance_info_cache with network_info: [{"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Releasing lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Instance network_info: |[{"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] Acquired lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Refreshing network info cache for port d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Start _get_guest_xml network_info=[{"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:48 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:48 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687654312',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687654312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687654312',id=7,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVIRvVgpCl6gpCUVYraECE9F2twh75iAaqKTUOaYSUrRkWQKf2WL4poV2Nn05B04237hvU5sVBPZjrK9g6G9G0jVb5yqSAEJKDMl+dDhanqXU9poBazEuQ9u3XxFpTTgg==',key_name='tempest-keypair-1285756563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0125799450d4db5804d3c14dac0f383',ramdisk_id='',reservation_id='r-5savtzs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1507634686',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1507634686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d535b1490c7149748f5e1e8abe972363',uuid=222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converting VIF {"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lazy-loading 'pci_devices' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:49 user nova-compute[75095]:   <uuid>222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f</uuid>
Nov 15 15:42:49 user nova-compute[75095]:   <name>instance-00000007</name>
Nov 15 15:42:49 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:49 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:49 user nova-compute[75095]:   <metadata>
Nov 15 15:42:49 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:49 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1687654312</nova:name>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:48</nova:creationTime>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:49 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:49 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:user uuid="d535b1490c7149748f5e1e8abe972363">tempest-VolumesAssistedSnapshotsTest-1507634686-project-member</nova:user>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:project uuid="f0125799450d4db5804d3c14dac0f383">tempest-VolumesAssistedSnapshotsTest-1507634686</nova:project>
Nov 15 15:42:49 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:49 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:49 user nova-compute[75095]:         <nova:port uuid="d045b7e2-05f1-4c3f-9492-b1a6a7945dc9">
Nov 15 15:42:49 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 15:42:49 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:49 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:49 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:49 user nova-compute[75095]:   </metadata>
Nov 15 15:42:49 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:49 user nova-compute[75095]:     <system>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="serial">222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f</entry>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="uuid">222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f</entry>
Nov 15 15:42:49 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:49 user nova-compute[75095]:     </system>
Nov 15 15:42:49 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:49 user nova-compute[75095]:   <os>
Nov 15 15:42:49 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:49 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:49 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:49 user nova-compute[75095]:   </os>
Nov 15 15:42:49 user nova-compute[75095]:   <features>
Nov 15 15:42:49 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:49 user nova-compute[75095]:     <apic/>
Nov 15 15:42:49 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:49 user nova-compute[75095]:   </features>
Nov 15 15:42:49 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:49 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:49 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:49 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:49 user nova-compute[75095]:   </clock>
Nov 15 15:42:49 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:49 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:49 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:49 user nova-compute[75095]:   </cpu>
Nov 15 15:42:49 user nova-compute[75095]:   <devices>
Nov 15 15:42:49 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:49 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:49 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk"/>
Nov 15 15:42:49 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:49 user nova-compute[75095]:     </disk>
Nov 15 15:42:49 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:49 user nova-compute[75095]:       <mac address="fa:16:3e:57:b3:e4"/>
Nov 15 15:42:49 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:49 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:49 user nova-compute[75095]:       <target dev="tapd045b7e2-05"/>
Nov 15 15:42:49 user nova-compute[75095]:     </interface>
Nov 15 15:42:49 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:49 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/console.log" append="off"/>
Nov 15 15:42:49 user nova-compute[75095]:     </serial>
Nov 15 15:42:49 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:49 user nova-compute[75095]:     <video>
Nov 15 15:42:49 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:49 user nova-compute[75095]:     </video>
Nov 15 15:42:49 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:49 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:49 user nova-compute[75095]:     </rng>
Nov 15 15:42:49 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:49 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:49 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:49 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:49 user nova-compute[75095]:   </devices>
Nov 15 15:42:49 user nova-compute[75095]: </domain>
Nov 15 15:42:49 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687654312',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687654312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687654312',id=7,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVIRvVgpCl6gpCUVYraECE9F2twh75iAaqKTUOaYSUrRkWQKf2WL4poV2Nn05B04237hvU5sVBPZjrK9g6G9G0jVb5yqSAEJKDMl+dDhanqXU9poBazEuQ9u3XxFpTTgg==',key_name='tempest-keypair-1285756563',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0125799450d4db5804d3c14dac0f383',ramdisk_id='',reservation_id='r-5savtzs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1507634686',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1507634686-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d535b1490c7149748f5e1e8abe972363',uuid=222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converting VIF {"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG os_vif [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee3e5e42-9937-54f5-bc55-a3019599d45b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd045b7e2-05, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd045b7e2-05, col_values=(('qos', UUID('04e1b85b-8cf3-4c41-9808-296e77c2ec67')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd045b7e2-05, col_values=(('external_ids', {'iface-id': 'd045b7e2-05f1-4c3f-9492-b1a6a7945dc9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:b3:e4', 'vm-uuid': '222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user nova-compute[75095]: INFO os_vif [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05')
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] No VIF found with MAC fa:16:3e:57:b3:e4, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Successfully created port: 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Instance spawned successfully.
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:49 user nova-compute[75095]: INFO nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Took 7.32 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:49 user sudo[85623]: pam_unix(sudo:session): session closed for user root
Nov 15 15:42:49 user nova-compute[75095]: INFO oslo.privsep.daemon [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Spawned new privsep daemon via rootwrap
Nov 15 15:42:49 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 15:42:49 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 15:42:49 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 15:42:49 user nova-compute[75095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85634
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b070bd-d16d-4ad3-9c39-67010a4eb558]: (2,) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:49 user nova-compute[75095]: INFO nova.compute.manager [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Took 8.68 seconds to build instance.
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ebb0e1bd-9ad7-4e22-9b67-f0c22695252d tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.805s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcec0da7-063f-471b-beb9-109dc7a8b859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.nvmeof [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ab622-f82a-42c5-a86b-8332beda3565]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d5c957-a25a-4a37-a7ad-172c1b5d9a71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e819910-2b9e-46cf-8c81-c41e41ed59ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:42:49 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:42:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ce5db-c2ba-4e99-a6c8-9d1f06ee4650]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== get_connector_properties: return (1840ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating existing volume attachment record: ca4cab61-bc59-47d9-ba51-cedab6adc9f1 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updated VIF entry in instance network info cache for port d045b7e2-05f1-4c3f-9492-b1a6a7945dc9. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updating instance_info_cache with network_info: [{"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8982fb16-886a-47b2-b52e-c9582a225419 req-af045c7b-2bbb-40c9-9112-e6eac3f122ab service nova] Releasing lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Successfully updated port: 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquired lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-changed-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Refreshing instance network info cache due to event network-changed-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] Acquiring lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:50 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG nova.network.neutron [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating instance_info_cache with network_info: [{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Releasing lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance network_info: |[{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] Acquired lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Refreshing network info cache for port 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updated VIF entry in instance network info cache for port 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating instance_info_cache with network_info: [{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b42eda48-4ed0-441e-986b-32bb5f1d11c9 req-2c0b01be-34d0-447f-8de0-a4d1d8777359 service nova] Releasing lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:42:53 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Instance spawned successfully.
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:42:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:53 user nova-compute[75095]: INFO nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Took 8.15 seconds to spawn the instance on the hypervisor.
Nov 15 15:42:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:42:53 user nova-compute[75095]: INFO nova.compute.manager [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Took 9.33 seconds to build instance.
Nov 15 15:42:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-930ed852-118a-4b86-b169-b5b5afe4edf6 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.486s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:54 user nova-compute[75095]: INFO nova.compute.claims [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Claim successful on node user
Nov 15 15:42:54 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.policy [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6594c4639944887bb9f9f3b9e6f4f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fcf1dcb392a4ec2b16fb1eb42cf3185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Creating image(s)
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "/opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "/opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.257s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.342s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk 1073741824" returned: 0 in 0.139s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.488s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.287s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Successfully created port: 86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Creating image(s)
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Ensure instance console log exists: /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start _get_guest_xml network_info=[{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'ca4cab61-bc59-47d9-ba51-cedab6adc9f1', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da2d8479-bd97-40d2-9fea-e3a979b21a1f', 'attached_at': '', 'detached_at': '', 'volume_id': '9c7f5944-102a-48ee-a60e-976f2b73357d', 'serial': '9c7f5944-102a-48ee-a60e-976f2b73357d'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:56 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:56 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Cannot resize image /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Ensure instance console log exists: /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connector [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Factory for ISCSI on None {{(pid=75095) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.011s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:42:56 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:42:56 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:42:56 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5e915d-92da-4d19-8cf7-d0aab97a4ce6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:42:56 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0740bca-61cf-40d1-955f-5f31a15db601]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d] added
Nov 15 15:42:57 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[203130f3-7e6a-47a4-bca2-296d2a6b05a7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f6ba8f-45b9-4fd3-8fd9-587908461121]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbLheKox {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbLheKox" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8d4668-dbaa-44c4-ac88-d815c04ea670]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbLheKox'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e510d7b9-e373-4d11-affa-c5b4c0c1f120]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcc38a1-a666-4158-b538-3317fcf71c9c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:42:57 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 15:42:57 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:42:57 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 15:42:57 user nova-compute[75095]: 
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[51adce5d-128e-431d-ac60-a7c5351da701]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]
Nov 15 15:42:57 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.
Nov 15 15:42:57 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b07e0b-e769-468a-b121-1bac165a1148]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e9f121-016e-4d5d-9d5f-622142edceef]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:42:57 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:42:57 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:42:57 user nova-compute[75095]: INFO nova.compute.claims [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Claim successful on node user
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.036s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f6999e-8be4-4b5c-bb80-3e101c3b61bf]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Successfully updated port: 86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquired lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-changed-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Refreshing instance network info cache due to event network-changed-86eb0c5a-02eb-435e-8c57-30c888dbdd10. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] Acquiring lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:42:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.policy [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00d60e3be37a4596befc5bdf2b796c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b022d733d2467d869f76f75385c807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Updating instance_info_cache with network_info: [{"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:42:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Creating image(s)
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "/opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "/opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "/opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.106s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23266653730656530', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266653730656530', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Releasing lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Instance network_info: |[{"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] Acquired lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Refreshing network info cache for port 86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Start _get_guest_xml network_info=[{"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:42:58 user nova-compute[75095]: WARNING nova.compute.manager [req-df41ecc1-3685-49ac-9c52-99a29bc193ce req-fb6c34ef-8ad1-4b12-bc2f-10b59e91ccee service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 for instance with vm_state active and task_state None.
Nov 15 15:42:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1458208636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lazy-loading 'pci_devices' on Instance uuid da2d8479-bd97-40d2-9fea-e3a979b21a1f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-224702509',display_name='tempest-VolumesActionsTest-instance-224702509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-224702509',id=9,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-902qz0wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:55Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=1d5375d6-c598-4233-9b6f-77d009100dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d5375d6-c598-4233-9b6f-77d009100dc0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:58 user nova-compute[75095]:   <uuid>da2d8479-bd97-40d2-9fea-e3a979b21a1f</uuid>
Nov 15 15:42:58 user nova-compute[75095]:   <name>instance-00000008</name>
Nov 15 15:42:58 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:58 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:58 user nova-compute[75095]:   <metadata>
Nov 15 15:42:58 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:58 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1458208636</nova:name>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:56</nova:creationTime>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:58 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:user uuid="967d134fe5cb41aaa8181e8372724dd7">tempest-ServerActionsV293TestJSON-454148145-project-member</nova:user>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:project uuid="1bae3e7bf05d46c48aab837a23446af4">tempest-ServerActionsV293TestJSON-454148145</nova:project>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:port uuid="1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d">
Nov 15 15:42:58 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:42:58 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:58 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:58 user nova-compute[75095]:   </metadata>
Nov 15 15:42:58 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:58 user nova-compute[75095]:     <system>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="serial">da2d8479-bd97-40d2-9fea-e3a979b21a1f</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="uuid">da2d8479-bd97-40d2-9fea-e3a979b21a1f</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:58 user nova-compute[75095]:     </system>
Nov 15 15:42:58 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:58 user nova-compute[75095]:   <os>
Nov 15 15:42:58 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:58 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:58 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:58 user nova-compute[75095]:   </os>
Nov 15 15:42:58 user nova-compute[75095]:   <features>
Nov 15 15:42:58 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:58 user nova-compute[75095]:     <apic/>
Nov 15 15:42:58 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:58 user nova-compute[75095]:   </features>
Nov 15 15:42:58 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:58 user nova-compute[75095]:   </clock>
Nov 15 15:42:58 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:58 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:58 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:58 user nova-compute[75095]:   </cpu>
Nov 15 15:42:58 user nova-compute[75095]:   <devices>
Nov 15 15:42:58 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:42:58 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:42:58 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 15:42:58 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:       <serial>9c7f5944-102a-48ee-a60e-976f2b73357d</serial>
Nov 15 15:42:58 user nova-compute[75095]:     </disk>
Nov 15 15:42:58 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:58 user nova-compute[75095]:       <mac address="fa:16:3e:85:8a:71"/>
Nov 15 15:42:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:58 user nova-compute[75095]:       <target dev="tap1e9fbda9-5b"/>
Nov 15 15:42:58 user nova-compute[75095]:     </interface>
Nov 15 15:42:58 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:58 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f/console.log" append="off"/>
Nov 15 15:42:58 user nova-compute[75095]:     </serial>
Nov 15 15:42:58 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:58 user nova-compute[75095]:     <video>
Nov 15 15:42:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:     </video>
Nov 15 15:42:58 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:58 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:58 user nova-compute[75095]:     </rng>
Nov 15 15:42:58 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:58 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:58 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:58 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:58 user nova-compute[75095]:   </devices>
Nov 15 15:42:58 user nova-compute[75095]: </domain>
Nov 15 15:42:58 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1458208636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG os_vif [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:42:58 user nova-compute[75095]:   <uuid>1d5375d6-c598-4233-9b6f-77d009100dc0</uuid>
Nov 15 15:42:58 user nova-compute[75095]:   <name>instance-00000009</name>
Nov 15 15:42:58 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:42:58 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:42:58 user nova-compute[75095]:   <metadata>
Nov 15 15:42:58 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:42:58 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:name>tempest-VolumesActionsTest-instance-224702509</nova:name>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:42:58</nova:creationTime>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:42:58 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:owner>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:user uuid="c6594c4639944887bb9f9f3b9e6f4f67">tempest-VolumesActionsTest-962818578-project-member</nova:user>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:project uuid="5fcf1dcb392a4ec2b16fb1eb42cf3185">tempest-VolumesActionsTest-962818578</nova:project>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:owner>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:42:58 user nova-compute[75095]:       <nova:ports>
Nov 15 15:42:58 user nova-compute[75095]:         <nova:port uuid="86eb0c5a-02eb-435e-8c57-30c888dbdd10">
Nov 15 15:42:58 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 15:42:58 user nova-compute[75095]:         </nova:port>
Nov 15 15:42:58 user nova-compute[75095]:       </nova:ports>
Nov 15 15:42:58 user nova-compute[75095]:     </nova:instance>
Nov 15 15:42:58 user nova-compute[75095]:   </metadata>
Nov 15 15:42:58 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:42:58 user nova-compute[75095]:     <system>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="serial">1d5375d6-c598-4233-9b6f-77d009100dc0</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="uuid">1d5375d6-c598-4233-9b6f-77d009100dc0</entry>
Nov 15 15:42:58 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:42:58 user nova-compute[75095]:     </system>
Nov 15 15:42:58 user nova-compute[75095]:   </sysinfo>
Nov 15 15:42:58 user nova-compute[75095]:   <os>
Nov 15 15:42:58 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:42:58 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:42:58 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:42:58 user nova-compute[75095]:   </os>
Nov 15 15:42:58 user nova-compute[75095]:   <features>
Nov 15 15:42:58 user nova-compute[75095]:     <acpi/>
Nov 15 15:42:58 user nova-compute[75095]:     <apic/>
Nov 15 15:42:58 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:42:58 user nova-compute[75095]:   </features>
Nov 15 15:42:58 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:42:58 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:42:58 user nova-compute[75095]:   </clock>
Nov 15 15:42:58 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:42:58 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:42:58 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:42:58 user nova-compute[75095]:   </cpu>
Nov 15 15:42:58 user nova-compute[75095]:   <devices>
Nov 15 15:42:58 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:42:58 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:42:58 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk"/>
Nov 15 15:42:58 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:     </disk>
Nov 15 15:42:58 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:42:58 user nova-compute[75095]:       <mac address="fa:16:3e:68:84:77"/>
Nov 15 15:42:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:42:58 user nova-compute[75095]:       <target dev="tap86eb0c5a-02"/>
Nov 15 15:42:58 user nova-compute[75095]:     </interface>
Nov 15 15:42:58 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:42:58 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/console.log" append="off"/>
Nov 15 15:42:58 user nova-compute[75095]:     </serial>
Nov 15 15:42:58 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:42:58 user nova-compute[75095]:     <video>
Nov 15 15:42:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:42:58 user nova-compute[75095]:     </video>
Nov 15 15:42:58 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:42:58 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:42:58 user nova-compute[75095]:     </rng>
Nov 15 15:42:58 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:42:58 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:42:58 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:42:58 user nova-compute[75095]:     </memballoon>
Nov 15 15:42:58 user nova-compute[75095]:   </devices>
Nov 15 15:42:58 user nova-compute[75095]: </domain>
Nov 15 15:42:58 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-224702509',display_name='tempest-VolumesActionsTest-instance-224702509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-224702509',id=9,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-902qz0wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:55Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=1d5375d6-c598-4233-9b6f-77d009100dc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG os_vif [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36981f1c-d4d8-5d30-8153-c4ce0bc0eaec', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f6225e0a-0da6-55f6-862d-d82f4573ced3', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.212s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e9fbda9-5b, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e9fbda9-5b, col_values=(('qos', UUID('f5bdec3b-8566-4bdb-93cd-25a961f297a5')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e9fbda9-5b, col_values=(('external_ids', {'iface-id': '1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:8a:71', 'vm-uuid': 'da2d8479-bd97-40d2-9fea-e3a979b21a1f'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: INFO os_vif [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b')
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86eb0c5a-02, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86eb0c5a-02, col_values=(('qos', UUID('37a850dc-250a-48e3-b7f4-12738c708309')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86eb0c5a-02, col_values=(('external_ids', {'iface-id': '86eb0c5a-02eb-435e-8c57-30c888dbdd10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:84:77', 'vm-uuid': '1d5375d6-c598-4233-9b6f-77d009100dc0'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:42:58 user nova-compute[75095]: INFO os_vif [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02')
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.239s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk 1073741824" returned: 0 in 0.062s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Successfully created port: 2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] No VIF found with MAC fa:16:3e:85:8a:71, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] No VIF found with MAC fa:16:3e:68:84:77, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Checking if we can resize image /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Updated VIF entry in instance network info cache for port 86eb0c5a-02eb-435e-8c57-30c888dbdd10. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Updating instance_info_cache with network_info: [{"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63798c5f-6821-4baa-a1ab-164284089e5a req-4409513d-dce5-43ae-a436-933bf94199a3 service nova] Releasing lock "refresh_cache-1d5375d6-c598-4233-9b6f-77d009100dc0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Cannot resize image /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Ensure instance console log exists: /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Successfully updated port: 2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquired lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing instance network info cache due to event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] Acquiring lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:42:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating instance_info_cache with network_info: [{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Releasing lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Instance network_info: |[{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] Acquired lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Start _get_guest_xml network_info=[{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:43:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-218954794',display_name='tempest-TestStampPattern-server-218954794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-218954794',id=10,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-07s35lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:58Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=37f47320-be8b-4d7a-b8a2-228e4894f881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'pci_devices' on Instance uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:43:00 user nova-compute[75095]:   <uuid>37f47320-be8b-4d7a-b8a2-228e4894f881</uuid>
Nov 15 15:43:00 user nova-compute[75095]:   <name>instance-0000000a</name>
Nov 15 15:43:00 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:43:00 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:43:00 user nova-compute[75095]:   <metadata>
Nov 15 15:43:00 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:43:00 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:name>tempest-TestStampPattern-server-218954794</nova:name>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:43:00</nova:creationTime>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:43:00 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:43:00 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:owner>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:user uuid="00d60e3be37a4596befc5bdf2b796c72">tempest-TestStampPattern-1242322391-project-member</nova:user>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:project uuid="08b022d733d2467d869f76f75385c807">tempest-TestStampPattern-1242322391</nova:project>
Nov 15 15:43:00 user nova-compute[75095]:       </nova:owner>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:43:00 user nova-compute[75095]:       <nova:ports>
Nov 15 15:43:00 user nova-compute[75095]:         <nova:port uuid="2922d764-7fb4-4c2d-a39e-6820cbbdd149">
Nov 15 15:43:00 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 15:43:00 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:00 user nova-compute[75095]:       </nova:ports>
Nov 15 15:43:00 user nova-compute[75095]:     </nova:instance>
Nov 15 15:43:00 user nova-compute[75095]:   </metadata>
Nov 15 15:43:00 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:43:00 user nova-compute[75095]:     <system>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="serial">37f47320-be8b-4d7a-b8a2-228e4894f881</entry>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="uuid">37f47320-be8b-4d7a-b8a2-228e4894f881</entry>
Nov 15 15:43:00 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:43:00 user nova-compute[75095]:     </system>
Nov 15 15:43:00 user nova-compute[75095]:   </sysinfo>
Nov 15 15:43:00 user nova-compute[75095]:   <os>
Nov 15 15:43:00 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:43:00 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:43:00 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:43:00 user nova-compute[75095]:   </os>
Nov 15 15:43:00 user nova-compute[75095]:   <features>
Nov 15 15:43:00 user nova-compute[75095]:     <acpi/>
Nov 15 15:43:00 user nova-compute[75095]:     <apic/>
Nov 15 15:43:00 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:43:00 user nova-compute[75095]:   </features>
Nov 15 15:43:00 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:43:00 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:43:00 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:43:00 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:43:00 user nova-compute[75095]:   </clock>
Nov 15 15:43:00 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:43:00 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:43:00 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:43:00 user nova-compute[75095]:   </cpu>
Nov 15 15:43:00 user nova-compute[75095]:   <devices>
Nov 15 15:43:00 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:43:00 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:43:00 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk"/>
Nov 15 15:43:00 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:43:00 user nova-compute[75095]:     </disk>
Nov 15 15:43:00 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:00 user nova-compute[75095]:       <mac address="fa:16:3e:28:fb:82"/>
Nov 15 15:43:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:00 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:00 user nova-compute[75095]:       <target dev="tap2922d764-7f"/>
Nov 15 15:43:00 user nova-compute[75095]:     </interface>
Nov 15 15:43:00 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:43:00 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/console.log" append="off"/>
Nov 15 15:43:00 user nova-compute[75095]:     </serial>
Nov 15 15:43:00 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:43:00 user nova-compute[75095]:     <video>
Nov 15 15:43:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:00 user nova-compute[75095]:     </video>
Nov 15 15:43:00 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:43:00 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:43:00 user nova-compute[75095]:     </rng>
Nov 15 15:43:00 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:43:00 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:43:00 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:43:00 user nova-compute[75095]:     </memballoon>
Nov 15 15:43:00 user nova-compute[75095]:   </devices>
Nov 15 15:43:00 user nova-compute[75095]: </domain>
Nov 15 15:43:00 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-218954794',display_name='tempest-TestStampPattern-server-218954794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-218954794',id=10,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-07s35lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:42:58Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=37f47320-be8b-4d7a-b8a2-228e4894f881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG os_vif [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08322688-5ee7-502f-bab8-e53602d41818', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2922d764-7f, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2922d764-7f, col_values=(('qos', UUID('364ddde5-a6e1-413e-a184-a2f5a6b86fd3')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2922d764-7f, col_values=(('external_ids', {'iface-id': '2922d764-7fb4-4c2d-a39e-6820cbbdd149', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:fb:82', 'vm-uuid': '37f47320-be8b-4d7a-b8a2-228e4894f881'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:00 user nova-compute[75095]: INFO os_vif [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f')
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:00 user nova-compute[75095]: WARNING nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 for instance with vm_state active and task_state None.
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] No waiting events found dispatching network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:00 user nova-compute[75095]: WARNING nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received unexpected event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 for instance with vm_state active and task_state None.
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] No waiting events found dispatching network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:00 user nova-compute[75095]: WARNING nova.compute.manager [req-5a2d73af-8fb8-423c-b0db-9fd1c90ad769 req-c41fd111-4ffb-4de7-816e-74849d86085f service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received unexpected event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 for instance with vm_state active and task_state None.
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No VIF found with MAC fa:16:3e:28:fb:82, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updated VIF entry in instance network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating instance_info_cache with network_info: [{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d071198-ab2d-4332-bbd6-a90ea2f4fe66 req-409f90a6-fe6e-44de-8dcf-67a6fe07565a service nova] Releasing lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:01 user nova-compute[75095]: WARNING nova.compute.manager [req-dd5f057d-82d0-4869-8524-5b5e3a63c722 req-9526a581-17f9-4365-a333-6c565a9a9548 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state building and task_state spawning.
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] No waiting events found dispatching network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:03 user nova-compute[75095]: WARNING nova.compute.manager [req-a6a0152f-9cd8-4d3d-b9ac-5ea598f64630 req-5ea3e3dc-cd87-4406-9572-1497bf4e90b3 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received unexpected event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 for instance with vm_state building and task_state spawning.
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:03 user nova-compute[75095]: WARNING nova.compute.manager [req-85d96117-b1ab-4f22-9b2a-8607e32c5e2a req-fb59d61c-eb40-46f1-b244-717e164cbf14 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state building and task_state spawning.
Nov 15 15:43:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] No waiting events found dispatching network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:05 user nova-compute[75095]: WARNING nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received unexpected event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 for instance with vm_state building and task_state spawning.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] No waiting events found dispatching network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:05 user nova-compute[75095]: WARNING nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received unexpected event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 for instance with vm_state building and task_state spawning.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] No waiting events found dispatching network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:05 user nova-compute[75095]: WARNING nova.compute.manager [req-344d620f-2543-4903-8778-7b7f2c52fc12 req-baf32260-e69a-4f2c-ae77-57d6f69f7b00 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received unexpected event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 for instance with vm_state building and task_state spawning.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance spawned successfully.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Instance spawned successfully.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Instance spawned successfully.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.compute.claims [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Claim successful on node user
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Took 9.14 seconds to spawn the instance on the hypervisor.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 82599a5d-33c4-4d13-ba6d-56cd211083ef {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Took 7.61 seconds to spawn the instance on the hypervisor.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:43:05 user nova-compute[75095]: INFO nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Took 10.53 seconds to spawn the instance on the hypervisor.
Nov 15 15:43:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:43:06 user nova-compute[75095]: INFO nova.compute.manager [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Took 18.91 seconds to build instance.
Nov 15 15:43:06 user nova-compute[75095]: INFO nova.compute.manager [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Took 8.75 seconds to build instance.
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa20a644-a87b-47b4-8319-4912826d2b56 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.091s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1a8a7f0a-080e-4b94-a1e3-d48ac030fcd5 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.939s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:06 user nova-compute[75095]: INFO nova.compute.manager [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Took 11.77 seconds to build instance.
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2581cf5-d623-41c3-a3d0-e3facf2e0f71 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.939s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.615s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:43:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updating instance_info_cache with network_info: [{"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-82599a5d-33c4-4d13-ba6d-56cd211083ef" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:06 user nova-compute[75095]: INFO nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Booting with volume 4bfa3eb6-9ee2-4c96-a742-309e7cde3eba at /dev/vda
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.policy [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '311fd99d09fa4e05bc4bae8e36963106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bafd945af714722847dc1ddb5f4d83f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b39c14-5684-4d62-851e-336ad4f7e16e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd935a-380f-4383-9d6f-93c261e6c94d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db61d188-7f0c-4d66-b9ed-68ddcf644d70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a985db2f-6ba4-4f14-8258-c78ed3afcf9e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:06 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37219efb-e3f6-4e8e-829c-7e1672cfb605]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating existing volume attachment record: db17db21-b943-4cdf-89db-2c9efe051431 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:43:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully created port: 7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully created port: 341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully created port: 00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully created port: da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully created port: b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7354MB free_disk=24.85995101928711GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: 7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.network.neutron [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82599a5d-33c4-4d13-ba6d-56cd211083ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82cf5365-8116-43dc-adcf-58006b301b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance da2d8479-bd97-40d2-9fea-e3a979b21a1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1d5375d6-c598-4233-9b6f-77d009100dc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.network.neutron [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:43:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b9b80465-ec63-4db1-bf44-bd947ffb02ff req-57cb3b1e-7d59-49d7-9c59-e9c42c67c90a service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.121s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: 00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:12 user nova-compute[75095]: INFO nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Booting with volume 1db461bf-3c73-4187-87e9-7ab73edb728b at /dev/vdb
Nov 15 15:43:12 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab37205-cb2e-4f1a-8c03-5b8466826a0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2bc132-08ca-4bbb-ade7-21efc2da813e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[392db235-8354-409a-a7b0-cb3b7417a0dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5823c739-1c37-4a8b-8d52-2932d2aeb977]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:13 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a256b84-7e2b-46f5-a9ae-75abb2f2afa5]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating existing volume attachment record: 4f42bce1-b7b7-4c03-9d69-cec8fa2f5aa4 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: 36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: 341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-36b7392d-3820-48a0-90d0-860fff179784. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b6db44-e2b5-4c4e-a580-cc9ec88f627f req-46eb8f0c-de4b-4643-bf5d-3356d5e0f30a service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: 00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-341fd64a-97b7-4ec0-81db-930b46620fd9. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Successfully updated port: b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.compute.manager [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.compute.manager [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eac17a50-2fe2-4a34-b9f3-1831e152f21e req-f6493350-61c7-404d-bbf6-52efb2f47911 service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:43:17 user nova-compute[75095]: INFO nova.compute.claims [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Claim successful on node user
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-da7231d3-714a-4a20-abc7-4334416a49aa. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:43:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:43:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.policy [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '931607b4077a4350b0381956bd4faaa0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70177e4d8b7343869d07d31286a352be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:43:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Creating image(s)
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "/opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "/opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "/opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.209s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: INFO nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Booting with volume 0773b155-9f8e-43af-a64c-436492b997bd at /dev/vdc
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Successfully created port: 775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk 1073741824" returned: 0 in 0.055s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c73cdf5-9ccd-4008-a5e5-ed4dbc182668]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06580fb-71f0-45cc-96dd-7cbb571814df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[adffb358-acaa-4b4b-9ab6-79bdd6d14305]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5620ffb5-a2a6-4155-b9f0-021eaa46f57c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:43:18 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10b96e6-8fc8-4b20-986f-bc3efa92c5db]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG os_brick.utils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating existing volume attachment record: 80b36cde-4beb-4210-a62e-fff4423a6c05 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:43:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Cannot resize image /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Ensure instance console log exists: /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance network_info: |[{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Successfully updated port: 775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquired lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-changed-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Refreshing instance network info cache due to event network-changed-775042fd-5cb9-4d4a-827c-85f47018d977. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] Acquiring lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updated VIF entry in instance network info cache for port da7231d3-714a-4a20-abc7-4334416a49aa. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating instance_info_cache with network_info: [{"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-b161bec2-6c63-465f-8d5a-d580fd93c43e. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Releasing lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Instance network_info: |[{"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] Acquired lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Refreshing network info cache for port 775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Start _get_guest_xml network_info=[{"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:43:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332046239',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332046239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332046239',id=12,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyjS2E2dXmspyMmcuiF1kVnMfHYEnn0lmf+dNIi1nOGq2tFlPpp2JK3OcoYtWTcguXTvQbeJHFZg3cwTkvRL0M3AGtCVQFCTl9xT2LwTG5yShixC6TU22vikeL089SppQ==',key_name='tempest-keypair-892964462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70177e4d8b7343869d07d31286a352be',ramdisk_id='',reservation_id='r-7nltqcg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1980171022',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1980171022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931607b4077a4350b0381956bd4faaa0',uuid=842fb5ef-d55d-494b-b5fe-b8f21bd02a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converting VIF {"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.objects.instance [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'pci_devices' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:43:19 user nova-compute[75095]:   <uuid>842fb5ef-d55d-494b-b5fe-b8f21bd02a1d</uuid>
Nov 15 15:43:19 user nova-compute[75095]:   <name>instance-0000000c</name>
Nov 15 15:43:19 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:43:19 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:43:19 user nova-compute[75095]:   <metadata>
Nov 15 15:43:19 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:43:19 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1332046239</nova:name>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:43:19</nova:creationTime>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:43:19 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:43:19 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:owner>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:user uuid="931607b4077a4350b0381956bd4faaa0">tempest-TestServerVolumeAttachmentScenario-1980171022-project-member</nova:user>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:project uuid="70177e4d8b7343869d07d31286a352be">tempest-TestServerVolumeAttachmentScenario-1980171022</nova:project>
Nov 15 15:43:19 user nova-compute[75095]:       </nova:owner>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:43:19 user nova-compute[75095]:       <nova:ports>
Nov 15 15:43:19 user nova-compute[75095]:         <nova:port uuid="775042fd-5cb9-4d4a-827c-85f47018d977">
Nov 15 15:43:19 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 15:43:19 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:19 user nova-compute[75095]:       </nova:ports>
Nov 15 15:43:19 user nova-compute[75095]:     </nova:instance>
Nov 15 15:43:19 user nova-compute[75095]:   </metadata>
Nov 15 15:43:19 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:43:19 user nova-compute[75095]:     <system>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="serial">842fb5ef-d55d-494b-b5fe-b8f21bd02a1d</entry>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="uuid">842fb5ef-d55d-494b-b5fe-b8f21bd02a1d</entry>
Nov 15 15:43:19 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:43:19 user nova-compute[75095]:     </system>
Nov 15 15:43:19 user nova-compute[75095]:   </sysinfo>
Nov 15 15:43:19 user nova-compute[75095]:   <os>
Nov 15 15:43:19 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:43:19 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:43:19 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:43:19 user nova-compute[75095]:   </os>
Nov 15 15:43:19 user nova-compute[75095]:   <features>
Nov 15 15:43:19 user nova-compute[75095]:     <acpi/>
Nov 15 15:43:19 user nova-compute[75095]:     <apic/>
Nov 15 15:43:19 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:43:19 user nova-compute[75095]:   </features>
Nov 15 15:43:19 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:43:19 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:43:19 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:43:19 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:43:19 user nova-compute[75095]:   </clock>
Nov 15 15:43:19 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:43:19 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:43:19 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:43:19 user nova-compute[75095]:   </cpu>
Nov 15 15:43:19 user nova-compute[75095]:   <devices>
Nov 15 15:43:19 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:43:19 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:43:19 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk"/>
Nov 15 15:43:19 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:43:19 user nova-compute[75095]:     </disk>
Nov 15 15:43:19 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:19 user nova-compute[75095]:       <mac address="fa:16:3e:84:38:51"/>
Nov 15 15:43:19 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:19 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:19 user nova-compute[75095]:       <target dev="tap775042fd-5c"/>
Nov 15 15:43:19 user nova-compute[75095]:     </interface>
Nov 15 15:43:19 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:43:19 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/console.log" append="off"/>
Nov 15 15:43:19 user nova-compute[75095]:     </serial>
Nov 15 15:43:19 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:43:19 user nova-compute[75095]:     <video>
Nov 15 15:43:19 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:19 user nova-compute[75095]:     </video>
Nov 15 15:43:19 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:43:19 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:43:19 user nova-compute[75095]:     </rng>
Nov 15 15:43:19 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:43:19 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:43:19 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:43:19 user nova-compute[75095]:     </memballoon>
Nov 15 15:43:19 user nova-compute[75095]:   </devices>
Nov 15 15:43:19 user nova-compute[75095]: </domain>
Nov 15 15:43:19 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332046239',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332046239',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332046239',id=12,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyjS2E2dXmspyMmcuiF1kVnMfHYEnn0lmf+dNIi1nOGq2tFlPpp2JK3OcoYtWTcguXTvQbeJHFZg3cwTkvRL0M3AGtCVQFCTl9xT2LwTG5yShixC6TU22vikeL089SppQ==',key_name='tempest-keypair-892964462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70177e4d8b7343869d07d31286a352be',ramdisk_id='',reservation_id='r-7nltqcg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1980171022',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1980171022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931607b4077a4350b0381956bd4faaa0',uuid=842fb5ef-d55d-494b-b5fe-b8f21bd02a1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converting VIF {"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG os_vif [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c53c0cb1-58f6-5fc2-9d12-5098349302b8', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap775042fd-5c, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap775042fd-5c, col_values=(('qos', UUID('38ac1528-8e19-4aa7-b700-78bb90c1a816')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap775042fd-5c, col_values=(('external_ids', {'iface-id': '775042fd-5cb9-4d4a-827c-85f47018d977', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:38:51', 'vm-uuid': '842fb5ef-d55d-494b-b5fe-b8f21bd02a1d'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:19 user nova-compute[75095]: INFO os_vif [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c')
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No VIF found with MAC fa:16:3e:84:38:51, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updated VIF entry in instance network info cache for port b161bec2-6c63-465f-8d5a-d580fd93c43e. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:43:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e82de10-0172-4c1b-a0b6-dbc21f8ff46f req-de8fb803-dce9-4501-a94d-8261b9e3fb5e service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:20 user nova-compute[75095]: DEBUG nova.network.neutron [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updated VIF entry in instance network info cache for port 775042fd-5cb9-4d4a-827c-85f47018d977. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:43:20 user nova-compute[75095]: DEBUG nova.network.neutron [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating instance_info_cache with network_info: [{"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:43:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1dc2446-28a0-4c01-b853-70ce7ad568ec req-f082b4a4-8fdc-4f6a-9ca0-142790be4f87 service nova] Releasing lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] No waiting events found dispatching network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:21 user nova-compute[75095]: WARNING nova.compute.manager [req-bd7aacd4-6803-4e95-a27b-8bdf98c74ba0 req-8d1920e0-ea37-4f0e-9e85-dab6d472cf97 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received unexpected event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 for instance with vm_state building and task_state spawning.
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:43:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Instance spawned successfully.
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] No waiting events found dispatching network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:23 user nova-compute[75095]: WARNING nova.compute.manager [req-fac2c967-091e-4cef-a835-6c4ab465e69d req-4cded093-1f9e-45dd-a282-79f7f7bfa2af service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received unexpected event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 for instance with vm_state building and task_state spawning.
Nov 15 15:43:23 user nova-compute[75095]: INFO nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:43:23 user nova-compute[75095]: INFO nova.compute.manager [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Took 6.25 seconds to build instance.
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a54c33d8-eaef-4d94-b52f-9953a981327d tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.344s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:43:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Creating image(s)
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Ensure instance console log exists: /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Start _get_guest_xml network_info=[{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'db17db21-b943-4cdf-89db-2c9efe051431', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvkPIUEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72', 'attached_at': '', 'detached_at': '', 'volume_id': '4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 'serial': '4bfa3eb6-9ee2-4c96-a742-309e7cde3eba'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '4f42bce1-b7b7-4c03-9d69-cec8fa2f5aa4', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfTBQNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72', 'attached_at': '', 'detached_at': '', 'volume_id': '1db461bf-3c73-4187-87e9-7ab73edb728b', 'serial': '1db461bf-3c73-4187-87e9-7ab73edb728b'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '80b36cde-4beb-4210-a62e-fff4423a6c05', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lykTioBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72', 'attached_at': '', 'detached_at': '', 'volume_id': '0773b155-9f8e-43af-a64c-436492b997bd', 'serial': '0773b155-9f8e-43af-a64c-436492b997bd'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:43:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvkPIUEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:23 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:23 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:23 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23dd24a-9d85-49d4-88b3-94006602073f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:43:23 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e59ffca-8ade-4679-8983-355804c1d53d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba] added
Nov 15 15:43:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d5e3b8-29c5-4569-a6e4-3a3d5b6e95db]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a5176-c9e0-4dae-bc9c-283250e90e5a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvkPIUEa {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvkPIUEa" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a57e96-677a-45fa-b6c2-3c1cc25325b4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvkPIUEa'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d54ea-e1ba-495f-a896-222f9c9a7ab2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0113cd-8735-489e-bb05-42911ac6c534]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4b7554-3de3-47ff-b14f-2e0bb7f09b09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260]
Nov 15 15:43:24 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260] successful.
Nov 15 15:43:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db46fe0e-be16-4a30-8c61-624018328569]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b6ab7-fc51-49b6-9670-d808c961030c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:24 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:24 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e748d4-8924-480b-b50c-1975f3b9c9ea]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvkPIUEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:43:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23865356536646531', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865356536646531', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfTBQNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:25 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:25 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:25 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75b8cd3-26ad-4698-982c-0b91575b3505]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:43:25 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b622c508-fcea-416d-89b7-2340ac0fdb70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b] added
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f66cb66-e70c-4cab-b3dd-f4df8219f5e5]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b593472-cc6e-4437-b719-4518ff5ab640]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfTBQNW {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bpfTBQNW" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b7513-cada-423f-be96-734b94bc794e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bpfTBQNW'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6f98f-8768-4d55-aeb2-d2d7da604e84]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[275d0578-0ecc-42f1-a37e-9001edf94b4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2b5c28-465b-4df0-91ef-a386d1049d1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260]
Nov 15 15:43:25 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260] successful.
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dfb2ee-dad0-4b4e-80b0-805de6adbb3d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed52290d-7b06-48db-aec9-ab25042221f5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:25 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad1ea4-3c1d-4f35-b55a-d1354e74d817]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfTBQNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26237303566353034', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237303566353034', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lykTioBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:43:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:43:26 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33925f15-9dd8-4092-adcb-648de828a846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:43:26 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[885b1d85-d496-4d2c-b0e6-45bc1205dd99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd] added
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c672c17-10db-47cd-b013-3e56c75ad77a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[190f2d3f-d7fe-4990-aeb8-e8ed4d33188c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lykTioBg {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lykTioBg" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1efbe4-31e2-458a-8122-6b44ffdef9ef]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lykTioBg'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0532395-0eaf-4255-8c8b-0e491d803af3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308fad4-f0f6-4226-a415-97e0dca95d08]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[849cd6f2-d0d1-4bdf-b102-4788254698e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260]
Nov 15 15:43:26 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260] successful.
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd3aa1-15bb-4ed6-b708-b64d099dd0d1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[653c1598-3778-4e31-b536-d93bb0d61772]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:43:26 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:43:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b699e85a-0ad2-45e2-8617-ea4c94df3fcd]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:43:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lykTioBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26139663535666336', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139663535666336', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.objects.instance [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lazy-loading 'pci_devices' on Instance uuid 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:43:27 user nova-compute[75095]:   <uuid>119015ba-aff2-4f8c-8e0c-5b9bf58a9c72</uuid>
Nov 15 15:43:27 user nova-compute[75095]:   <name>instance-0000000b</name>
Nov 15 15:43:27 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:43:27 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:43:27 user nova-compute[75095]:   <metadata>
Nov 15 15:43:27 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:43:27 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:name>tempest-device-tagging-server-1215604240</nova:name>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:43:23</nova:creationTime>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:43:27 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:43:27 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:owner>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:user uuid="311fd99d09fa4e05bc4bae8e36963106">tempest-TaggedBootDevicesTest_v242-1051292866-project-member</nova:user>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:project uuid="2bafd945af714722847dc1ddb5f4d83f">tempest-TaggedBootDevicesTest_v242-1051292866</nova:project>
Nov 15 15:43:27 user nova-compute[75095]:       </nova:owner>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:43:27 user nova-compute[75095]:       <nova:ports>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="36b7392d-3820-48a0-90d0-860fff179784">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.88" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="341fd64a-97b7-4ec0-81db-930b46620fd9">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.234" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="da7231d3-714a-4a20-abc7-4334416a49aa">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:         <nova:port uuid="b161bec2-6c63-465f-8d5a-d580fd93c43e">
Nov 15 15:43:27 user nova-compute[75095]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 15:43:27 user nova-compute[75095]:         </nova:port>
Nov 15 15:43:27 user nova-compute[75095]:       </nova:ports>
Nov 15 15:43:27 user nova-compute[75095]:     </nova:instance>
Nov 15 15:43:27 user nova-compute[75095]:   </metadata>
Nov 15 15:43:27 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:43:27 user nova-compute[75095]:     <system>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="serial">119015ba-aff2-4f8c-8e0c-5b9bf58a9c72</entry>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="uuid">119015ba-aff2-4f8c-8e0c-5b9bf58a9c72</entry>
Nov 15 15:43:27 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:43:27 user nova-compute[75095]:     </system>
Nov 15 15:43:27 user nova-compute[75095]:   </sysinfo>
Nov 15 15:43:27 user nova-compute[75095]:   <os>
Nov 15 15:43:27 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:43:27 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:43:27 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:43:27 user nova-compute[75095]:   </os>
Nov 15 15:43:27 user nova-compute[75095]:   <features>
Nov 15 15:43:27 user nova-compute[75095]:     <acpi/>
Nov 15 15:43:27 user nova-compute[75095]:     <apic/>
Nov 15 15:43:27 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:43:27 user nova-compute[75095]:   </features>
Nov 15 15:43:27 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:43:27 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:43:27 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:43:27 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:43:27 user nova-compute[75095]:   </clock>
Nov 15 15:43:27 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:43:27 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:43:27 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:43:27 user nova-compute[75095]:   </cpu>
Nov 15 15:43:27 user nova-compute[75095]:   <devices>
Nov 15 15:43:27 user nova-compute[75095]:     <disk type="file" device="cdrom">
Nov 15 15:43:27 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 15:43:27 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/disk.config"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="hda" bus="ide"/>
Nov 15 15:43:27 user nova-compute[75095]:     </disk>
Nov 15 15:43:27 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:43:27 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:43:27 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <serial>4bfa3eb6-9ee2-4c96-a742-309e7cde3eba</serial>
Nov 15 15:43:27 user nova-compute[75095]:     </disk>
Nov 15 15:43:27 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:43:27 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:43:27 user nova-compute[75095]:       <source dev="/dev/sdd"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <serial>1db461bf-3c73-4187-87e9-7ab73edb728b</serial>
Nov 15 15:43:27 user nova-compute[75095]:     </disk>
Nov 15 15:43:27 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:43:27 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:43:27 user nova-compute[75095]:       <source dev="/dev/sde"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="vdc" bus="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <serial>0773b155-9f8e-43af-a64c-436492b997bd</serial>
Nov 15 15:43:27 user nova-compute[75095]:     </disk>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:46:10:2c"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tap7ccbf7d7-ca"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:cf:68:35"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tap00b97002-29"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:60:2a:fe"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tap36b7392d-38"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:37:1d:d3"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tap341fd64a-97"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:e6:8f:bd"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tap00bc3fa6-3a"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:d6:ff:83"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tapda7231d3-71"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:43:27 user nova-compute[75095]:       <mac address="fa:16:3e:a7:2a:eb"/>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:43:27 user nova-compute[75095]:       <target dev="tapb161bec2-6c"/>
Nov 15 15:43:27 user nova-compute[75095]:     </interface>
Nov 15 15:43:27 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:43:27 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/console.log" append="off"/>
Nov 15 15:43:27 user nova-compute[75095]:     </serial>
Nov 15 15:43:27 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:43:27 user nova-compute[75095]:     <video>
Nov 15 15:43:27 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:43:27 user nova-compute[75095]:     </video>
Nov 15 15:43:27 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:43:27 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:43:27 user nova-compute[75095]:     </rng>
Nov 15 15:43:27 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:43:27 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:43:27 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:43:27 user nova-compute[75095]:     </memballoon>
Nov 15 15:43:27 user nova-compute[75095]:   </devices>
Nov 15 15:43:27 user nova-compute[75095]: </domain>
Nov 15 15:43:27 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '276bdb23-acbc-5641-9f0c-8c4e2de97067', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ccbf7d7-ca, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ccbf7d7-ca, col_values=(('qos', UUID('9ca37fe7-3e2f-4b4e-aa72-3b0b615dbf35')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ccbf7d7-ca, col_values=(('external_ids', {'iface-id': '7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:10:2c', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1588a412-a3e7-5dca-9add-522313649479', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00b97002-29, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00b97002-29, col_values=(('qos', UUID('aa7a3851-68ac-49aa-a898-4158c78da885')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00b97002-29, col_values=(('external_ids', {'iface-id': '00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:68:35', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bd0422e-17b5-51d8-8e33-db92a5a240be', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap36b7392d-38, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap36b7392d-38, col_values=(('qos', UUID('656e6643-3b2a-41ab-b8d1-e1f51b7e1f23')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap36b7392d-38, col_values=(('external_ids', {'iface-id': '36b7392d-3820-48a0-90d0-860fff179784', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:2a:fe', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '210ae46c-9eb5-5956-ae9b-c3e530e5eac5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap341fd64a-97, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap341fd64a-97, col_values=(('qos', UUID('f7ac944e-bac0-4d89-8b08-44600acd67a4')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap341fd64a-97, col_values=(('external_ids', {'iface-id': '341fd64a-97b7-4ec0-81db-930b46620fd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:1d:d3', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '001b202c-fb76-5388-9485-ed690f7d53c0', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00bc3fa6-3a, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00bc3fa6-3a, col_values=(('qos', UUID('f6a94239-b94e-483b-bd87-5e0500895e55')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00bc3fa6-3a, col_values=(('external_ids', {'iface-id': '00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:8f:bd', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb589fde-a462-5c73-8da3-92f8330e1481', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda7231d3-71, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda7231d3-71, col_values=(('qos', UUID('513bc688-a49a-42c7-8c25-3c81190ff576')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda7231d3-71, col_values=(('external_ids', {'iface-id': 'da7231d3-714a-4a20-abc7-4334416a49aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:ff:83', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49d6250f-12ee-5af7-b339-99c9b0616c87', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb161bec2-6c, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb161bec2-6c, col_values=(('qos', UUID('3f96bbf3-0956-4ada-978d-1be2f391fece')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb161bec2-6c, col_values=(('external_ids', {'iface-id': 'b161bec2-6c63-465f-8d5a-d580fd93c43e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:2a:eb', 'vm-uuid': '119015ba-aff2-4f8c-8e0c-5b9bf58a9c72'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:28 user nova-compute[75095]: INFO os_vif [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c')
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] No BDM found with device name hda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] No VIF found with MAC fa:16:3e:46:10:2c, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:43:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] No VIF found with MAC fa:16:3e:e6:8f:bd, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:43:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Using config drive
Nov 15 15:43:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Creating config drive at /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/disk.config
Nov 15 15:43:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbj21gk_s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:43:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbj21gk_s" returned: 0 in 0.064s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:30 user nova-compute[75095]: WARNING nova.compute.manager [req-85d14bec-01bd-4167-a189-0c0e246cee63 req-119b1777-b2d6-434f-8cc9-4b91ad547f80 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 for instance with vm_state building and task_state spawning.
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:31 user nova-compute[75095]: WARNING nova.compute.manager [req-b1d59cb9-55e1-4825-9bcb-d429ca6bf4c2 req-5c6060b7-b0c1-4ebe-8244-04eb80eff9da service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a for instance with vm_state building and task_state spawning.
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:32 user nova-compute[75095]: WARNING nova.compute.manager [req-185a6d12-0830-416a-bc9f-52103581e165 req-106eab02-b727-445b-89bc-0c22df26960f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb for instance with vm_state building and task_state spawning.
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-4e70f579-fbd6-4d2d-991c-769a240a35e5 req-c1beec4f-0860-47ed-b395-f3f36a26a668 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:33 user nova-compute[75095]: WARNING nova.compute.manager [req-6cce7bae-1015-4c34-9f62-81655ca42843 req-517151c2-957a-469a-b29a-88daa2fe58b7 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 for instance with vm_state building and task_state spawning.
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:34 user nova-compute[75095]: WARNING nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb for instance with vm_state building and task_state spawning.
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:34 user nova-compute[75095]: WARNING nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e for instance with vm_state building and task_state spawning.
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:34 user nova-compute[75095]: WARNING nova.compute.manager [req-b437311b-1cd5-4702-bfe4-f464a3b923be req-c58c82be-375c-45c7-bdbc-2826661cb987 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e for instance with vm_state building and task_state spawning.
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:43:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance spawned successfully.
Nov 15 15:43:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:43:35 user nova-compute[75095]: WARNING nova.compute.manager [req-21c643f2-cf9f-4cdc-8659-292d02869718 req-78c4091e-a873-46d1-97c6-2ac0862958a0 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa for instance with vm_state building and task_state spawning.
Nov 15 15:43:35 user nova-compute[75095]: INFO nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Took 11.24 seconds to spawn the instance on the hypervisor.
Nov 15 15:43:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:43:35 user nova-compute[75095]: INFO nova.compute.manager [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Took 29.43 seconds to build instance.
Nov 15 15:43:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-38ede8b9-1a9a-4c89-8457-1510f52f2ceb tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.530s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:43:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:43:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lazy-loading 'flavor' on Instance uuid 82599a5d-33c4-4d13-ba6d-56cd211083ef {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:05 user nova-compute[75095]: INFO nova.compute.manager [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Attaching volume ada8e573-9ba7-4043-8b5d-09fa274a6692 to /dev/vdb
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.utils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a616db-eab6-41b2-ada3-a9575f4db486]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee55275-fa8e-432b-a850-bb75151c37b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fe9e73-7a38-4958-93c4-deb433b0f12b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be13853-2a06-42fa-af2b-988b6a5550c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:05 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ae1f9e-efbf-46e9-aefd-d81997050191]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG os_brick.utils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:05 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updating existing volume attachment record: 9340e1df-bde7-43b5-95c7-b362e2803405 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:44:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-changed-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Refreshing instance network info cache due to event network-changed-b02c9c61-0809-40d0-be33-1d8b596c67b2. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Refreshing network info cache for port b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updated VIF entry in instance network info cache for port b02c9c61-0809-40d0-be33-1d8b596c67b2. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1519a631-7120-474d-b7d2-d650adbd8e7f req-1a8057bd-63cf-4772-a20e-405514608fc8 service nova] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing instance network info cache due to event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated VIF entry in instance network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1284a08a-3405-45c2-a98c-789f247242b1 req-fd0ec6df-dd91-48f5-b0a7-30a59b54825f service nova] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOKQMrgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:10 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:10 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:10 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68513018-e1ab-4e54-ab3c-5975bc1cf3de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:44:10 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbaff25-59ff-4e08-9789-ccdf39312274]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692] added
Nov 15 15:44:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51d1c23-bc1d-41d9-bfc8-fa282d53d940]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9c6bc-de7d-4539-ab94-0ae531919bae]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOKQMrgd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOKQMrgd" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a0ea1b-af6d-4836-912a-3d3ce86ca402]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOKQMrgd'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8941199f-3c0a-4133-a507-17166a889e25]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaadef8-dd72-4270-b4b5-3eb0e9b7c4ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:10 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1600aa-0dd7-48ba-8132-1f6c0c7364b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260]
Nov 15 15:44:10 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41018d88-1e34-45d8-9894-2f206c3fa811]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d95f974-7e0b-435a-b8f1-08755d0ba402]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)
Nov 15 15:44:11 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:11 user nova-compute[75095]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)
Nov 15 15:44:11 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebba59b-60fa-4b7c-a8e0-4d599450ca71]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOKQMrgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:44:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:44:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=6614MB free_disk=24.761241912841797GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23830646561633165', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830646561633165', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance da2d8479-bd97-40d2-9fea-e3a979b21a1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1d5375d6-c598-4233-9b6f-77d009100dc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82cf5365-8116-43dc-adcf-58006b301b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82599a5d-33c4-4d13-ba6d-56cd211083ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lazy-loading 'flavor' on Instance uuid 82599a5d-33c4-4d13-ba6d-56cd211083ef {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:44:12 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:12 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:44:12 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:12 user nova-compute[75095]:   <serial>ada8e573-9ba7-4043-8b5d-09fa274a6692</serial>
Nov 15 15:44:12 user nova-compute[75095]: </disk>
Nov 15 15:44:12 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] No VIF found with MAC fa:16:3e:c5:f3:fb, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f4cd33db-fde5-41b0-a2ea-3fa30a293cd8 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.037s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing instance network info cache due to event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updated VIF entry in instance network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3c27331-3b88-4549-b5dd-d2c6dbf80ecb req-3d115d57-1d94-4c6a-b5a6-8b12d899c5d0 service nova] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:13 user nova-compute[75095]: INFO nova.compute.manager [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Terminating instance
Nov 15 15:44:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.compute.manager [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] instance snapshotting
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Beginning live snapshot process
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Instance destroyed successfully.
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lazy-loading 'resources' on Instance uuid 82599a5d-33c4-4d13-ba6d-56cd211083ef {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1420653092',display_name='tempest-DeleteServersTestJSON-server-1420653092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1420653092',id=1,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7f3f18923d3425e8db038b5d83dddbc',ramdisk_id='',reservation_id='r-bp77w98v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-246956719',owner_user_name='tempest-DeleteServersTestJSON-246956719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:35Z,user_data=None,user_id='06d872503684414b89a28d9fea2f4ee9',uuid=82599a5d-33c4-4d13-ba6d-56cd211083ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converting VIF {"id": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "address": "fa:16:3e:c5:f3:fb", "network": {"id": "c4b76d52-df84-4523-9fff-16493253d944", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-928922323-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7f3f18923d3425e8db038b5d83dddbc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaebd6f1-15", "ovs_interfaceid": "daebd6f1-15b4-4b4d-9082-f4628e874aa3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_vif [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaebd6f1-15, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36a3d816-777d-4e01-b550-cfab4a67c8fc) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:14 user nova-compute[75095]: INFO os_vif [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:f3:fb,bridge_name='br-int',has_traffic_filtering=True,id=daebd6f1-15b4-4b4d-9082-f4628e874aa3,network=Network(c4b76d52-df84-4523-9fff-16493253d944),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaebd6f1-15')
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOKQMrgd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21eb7c6-22ec-411a-8595-c2a25665afc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:44:14 user nova-compute[75095]: No targets found.
Nov 15 15:44:14 user nova-compute[75095]: iSNS:
Nov 15 15:44:14 user nova-compute[75095]: No targets found.
Nov 15 15:44:14 user nova-compute[75095]: STATIC:
Nov 15 15:44:14 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:44:14 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:14 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:14 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:44:14 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:14 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:14 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692
Nov 15 15:44:14 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:14 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:14 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba
Nov 15 15:44:14 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:14 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:14 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:44:14 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:14 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:14 user nova-compute[75095]: FIRMWARE:
Nov 15 15:44:14 user nova-compute[75095]: No targets found.
Nov 15 15:44:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:44:14 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:44:14 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad97a9-45b0-4a36-ab33-2a5e92f76e23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[340a66dc-3ebd-4e8e-8db1-47588f42ff25]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)
Nov 15 15:44:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:14 user nova-compute[75095]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 (non-flash)
Nov 15 15:44:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5968bd6830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692'): ({'sdf'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Removing single pathed devices sdf {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c824bd-4178-42f8-acfa-b1358ec65be5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd73d0a7-1026-4791-9198-8989236c273d]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Flushing IO for device /dev/sdf {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[136f4ce5-d82d-4780-b5c4-2f69180cdae5]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f13795-0248-4eed-8135-855864c81f69]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e257d0-9905-419e-bf3f-2109e62c6351]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a32bee-b122-42d6-b645-f9d581ae7abf]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260]
Nov 15 15:44:14 user nova-compute[75095]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ada8e573-9ba7-4043-8b5d-09fa274a6692 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[561207ad-551a-454d-8df9-c9dc54385aad]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] <== disconnect_volume: return (360ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Deleting instance files /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef_del
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Deletion of /opt/stack/data/nova/instances/82599a5d-33c4-4d13-ba6d-56cd211083ef_del complete
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75095) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.host [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] UEFI support detected
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.compute.manager [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1.delta 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1.delta 1073741824" returned: 0 in 0.047s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-unplugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] No waiting events found dispatching network-vif-unplugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-unplugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Acquiring lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] No waiting events found dispatching network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:14 user nova-compute[75095]: WARNING nova.compute.manager [req-66fbd2b4-b28b-4482-9211-5701c860f67c req-7812f628-320c-4519-a595-2e72aef64516 service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received unexpected event network-vif-plugged-daebd6f1-15b4-4b4d-9082-f4628e874aa3 for instance with vm_state active and task_state deleting.
Nov 15 15:44:15 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:15 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Took 0.65 seconds to deallocate network for instance.
Nov 15 15:44:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-c7b0e442-3ea6-4249-af5c-0b115d1251ae req-8ab815c1-0509-4bc3-9762-cb73b5d375ad service nova] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Received event network-vif-deleted-daebd6f1-15b4-4b4d-9082-f4628e874aa3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] COPY block job progress, current cursor: 3866624 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:44:16 user nova-compute[75095]: INFO nova.compute.manager [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] [instance: 82599a5d-33c4-4d13-ba6d-56cd211083ef] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:44:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 15:44:16 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1.delta /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1.delta /opt/stack/data/nova/instances/snapshots/tmpxk4fciz2/b2b427322abb45e08186c321a38918b1" returned: 0 in 0.267s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Snapshot extracted, beginning image upload
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:16 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Deleted allocations for instance 82599a5d-33c4-4d13-ba6d-56cd211083ef
Nov 15 15:44:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-94ab60ba-7bbf-4cc7-bce8-156cd2b4d053 tempest-DeleteServersTestJSON-246956719 tempest-DeleteServersTestJSON-246956719-project-member] Lock "82599a5d-33c4-4d13-ba6d-56cd211083ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.126s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Snapshot image upload complete
Nov 15 15:44:18 user nova-compute[75095]: INFO nova.compute.manager [None req-6e0d687a-3e11-496d-9091-6ecadc7ff492 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Took 4.82 seconds to snapshot the instance on the hypervisor.
Nov 15 15:44:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-changed-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Refreshing instance network info cache due to event network-changed-79e10ded-1e90-48a9-8849-a5580ff15a8d. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] Acquiring lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] Acquired lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Refreshing network info cache for port 79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updated VIF entry in instance network info cache for port 79e10ded-1e90-48a9-8849-a5580ff15a8d. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updating instance_info_cache with network_info: [{"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-be7b0cb8-9093-472e-9325-f2d7113098d7 req-aefd3867-7cfb-445d-b385-cfe149bdbe84 service nova] Releasing lock "refresh_cache-205e57b3-4d57-43b8-9fac-484a8511e1e8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lazy-loading 'flavor' on Instance uuid 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:24 user nova-compute[75095]: INFO nova.compute.manager [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Attaching volume 215c525b-ac7b-4676-a4da-a15d68ba8e0b to /dev/sdc
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.utils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed63ff3-d49a-420f-b8b9-122ce1072122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c0df1a-7846-47d2-86dd-63a7b7516fe3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bde0670-1511-4e29-8e6a-5d9f7e8b881a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[927376ab-e12d-454f-9cfa-e79759d63377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:24 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee45b5b1-5feb-4171-bec0-46413e7e5eba]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG os_brick.utils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:24 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updating existing volume attachment record: 8a0f9145-9189-4139-854e-ce0e70e1f2ef {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsClzTRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:29 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:29 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:29 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f083b7c-49ee-45be-87fc-42863b60b3bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:44:29 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7fe48-c114-41c2-b513-9d3c117c93e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b] added
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f6e72-d790-4037-8824-b055ab89bf9a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e51d8-82e1-40ae-81ba-4366b598dba7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsClzTRP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bsClzTRP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4d1dc4-9847-4ba4-93ae-ab5a89a8df8e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bsClzTRP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eff4b9-9175-4b26-857d-5e70c12cb0ef]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb9ccb5-5a07-4db7-9813-803f28c86bd2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce449de-a777-4b2d-8cc4-c9f402f2d8f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260]
Nov 15 15:44:29 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87867b3a-9566-4788-90d2-6f3c42c26382]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bdfff6-2e45-45cf-a7d7-140eac6ec835]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:29 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72706e31-7ec0-4ac1-a00e-7f56c30e86e2]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsClzTRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26263306165366565', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263306165366565', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:44:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lazy-loading 'flavor' on Instance uuid 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:44:31 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:31 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:44:31 user nova-compute[75095]:   <target dev="sdc" bus="scsi"/>
Nov 15 15:44:31 user nova-compute[75095]:   <serial>215c525b-ac7b-4676-a4da-a15d68ba8e0b</serial>
Nov 15 15:44:31 user nova-compute[75095]:   <address type="drive" controller="0" unit="2"/>
Nov 15 15:44:31 user nova-compute[75095]: </disk>
Nov 15 15:44:31 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No BDM found with device name sda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] No VIF found with MAC fa:16:3e:bb:92:8f, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ef7b2c6-1f6c-4c20-b7fb-4f28f765c9a7 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.790s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-changed-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing instance network info cache due to event network-changed-6114f792-1084-4110-a522-3e22b0991f20. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing network info cache for port 6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updated VIF entry in instance network info cache for port 6114f792-1084-4110-a522-3e22b0991f20. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1187394-9b1b-459d-b787-64ac4d9201b9 req-f4545a80-61bd-4b7d-abc9-e39d40c99f89 service nova] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'pci_requests' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.objects.base [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Object Instance<82cf5365-8116-43dc-adcf-58006b301b6b> lazy-loaded attributes: flavor,pci_requests {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.policy [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffb7f652d1ea433a92ffcccf0b93f3b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cb8bb4f0ef14c929f8ba8c60295b2ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:32 user nova-compute[75095]: INFO nova.compute.manager [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Detaching volume 215c525b-ac7b-4676-a4da-a15d68ba8e0b
Nov 15 15:44:32 user nova-compute[75095]: INFO nova.virt.block_device [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Attempting to driver detach volume 215c525b-ac7b-4676-a4da-a15d68ba8e0b from mountpoint /dev/sdc
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Attempting to detach device sdc from instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:32 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:32 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:44:32 user nova-compute[75095]:   <target dev="sdc" bus="scsi"/>
Nov 15 15:44:32 user nova-compute[75095]:   <serial>215c525b-ac7b-4676-a4da-a15d68ba8e0b</serial>
Nov 15 15:44:32 user nova-compute[75095]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 15:44:32 user nova-compute[75095]: </disk>
Nov 15 15:44:32 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Successfully detached device sdc from instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 from the persistent domain config.
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:44:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:32 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:32 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:44:32 user nova-compute[75095]:   <target dev="sdc" bus="scsi"/>
Nov 15 15:44:32 user nova-compute[75095]:   <serial>215c525b-ac7b-4676-a4da-a15d68ba8e0b</serial>
Nov 15 15:44:32 user nova-compute[75095]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 15:44:32 user nova-compute[75095]: </disk>
Nov 15 15:44:32 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Successfully created port: b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Successfully updated port: b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-changed-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing instance network info cache due to event network-changed-b49e134b-013a-4df1-92bf-fc794a88d5d6. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Refreshing network info cache for port b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG os_vif [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'edecf49e-389c-5fbc-a8dd-08d0d9659730', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb49e134b-01, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb49e134b-01, col_values=(('qos', UUID('6faed2f8-a735-4138-a0bd-bda6d8ee9c26')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb49e134b-01, col_values=(('external_ids', {'iface-id': 'b49e134b-013a-4df1-92bf-fc794a88d5d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:f8:bd', 'vm-uuid': '82cf5365-8116-43dc-adcf-58006b301b6b'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: INFO os_vif [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01')
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] attach device xml: <interface type="ethernet">
Nov 15 15:44:34 user nova-compute[75095]:   <mac address="fa:16:3e:8b:f8:bd"/>
Nov 15 15:44:34 user nova-compute[75095]:   <model type="virtio"/>
Nov 15 15:44:34 user nova-compute[75095]:   <mtu size="1442"/>
Nov 15 15:44:34 user nova-compute[75095]:   <target dev="tapb49e134b-01"/>
Nov 15 15:44:34 user nova-compute[75095]: </interface>
Nov 15 15:44:34 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:35 user nova-compute[75095]: WARNING nova.compute.manager [req-e6834e91-62f0-4d7a-8913-be4b412a08d2 req-9ccdbac7-823d-4931-a149-cf5e23251753 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 for instance with vm_state active and task_state None.
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name hda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No VIF found with MAC fa:16:3e:36:9f:cd, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:44:35 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:44:35</nova:creationTime>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:44:35 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:44:35 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:owner>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:44:35 user nova-compute[75095]:   </nova:owner>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:44:35 user nova-compute[75095]:   <nova:ports>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:44:35 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:44:35 user nova-compute[75095]:     </nova:port>
Nov 15 15:44:35 user nova-compute[75095]:     <nova:port uuid="b49e134b-013a-4df1-92bf-fc794a88d5d6">
Nov 15 15:44:35 user nova-compute[75095]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Nov 15 15:44:35 user nova-compute[75095]:     </nova:port>
Nov 15 15:44:35 user nova-compute[75095]:   </nova:ports>
Nov 15 15:44:35 user nova-compute[75095]: </nova:instance>
Nov 15 15:44:35 user nova-compute[75095]:  {{(pid=75095) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5891cc24-b406-4720-9b32-2b9762ca4c34 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.065s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.network.neutron [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updated VIF entry in instance network info cache for port b49e134b-013a-4df1-92bf-fc794a88d5d6. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.network.neutron [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ee910085-1ee2-4d16-9c95-11c828ba1c84 req-94cf4eb3-393c-4a75-b9e9-8c749fd5d461 service nova] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-changed-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Refreshing instance network info cache due to event network-changed-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] Acquiring lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] Acquired lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.network.neutron [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Refreshing network info cache for port d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:36 user nova-compute[75095]: INFO nova.compute.manager [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Attaching volume 11b808da-46fa-464b-9c70-6290d08f23c7 to /dev/vdb
Nov 15 15:44:36 user nova-compute[75095]: DEBUG nova.objects.instance [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lazy-loading 'flavor' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.utils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[633358c0-dea8-49eb-a4aa-ac7120497dec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bdea38-e87e-4547-8d69-51febfc5f314]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce81622-f39e-4353-8e20-7457249ecedb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec108657-45b3-4541-a561-32ab383a6043]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG nova.network.neutron [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updated VIF entry in instance network info cache for port d045b7e2-05f1-4c3f-9492-b1a6a7945dc9. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG nova.network.neutron [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updating instance_info_cache with network_info: [{"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:36 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41679ec8-8c8e-43db-a111-f1adc2e54e38]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.utils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating existing volume attachment record: 2b1b736b-9104-44eb-a17b-50037d48b581 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac753c1-fadf-4b03-8886-02630928d9eb req-7c280d3b-4d6b-403e-88a8-e9fac6d933ec service nova] Releasing lock "refresh_cache-222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:36 user nova-compute[75095]: INFO nova.compute.manager [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Attaching volume dfe5f380-ce03-4772-bde8-1798f386583d to /dev/vdb
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.utils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c73511f-0fed-4ccf-9aa8-295304c40da2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e20266-71af-441f-b774-f0441cee7bfc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8102067b-a212-4cb5-b58b-dda93572110d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30e22c8-c4dd-4970-a8fc-faa97306d733]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:36 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3c9a61-eaff-4955-8c9e-63a1e233053e]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG os_brick.utils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:36 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updating existing volume attachment record: cd6182d5-6cec-4edd-8846-7f037e2382f9 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:37 user nova-compute[75095]: WARNING nova.compute.manager [req-d99b6d1f-c477-4fb1-9501-52bced27dad4 req-0e1621a3-82d7-4466-ba87-18780e7e78e6 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 for instance with vm_state active and task_state None.
Nov 15 15:44:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-changed-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Refreshing instance network info cache due to event network-changed-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] Acquiring lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] Acquired lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Refreshing network info cache for port 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updated VIF entry in instance network info cache for port 1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating instance_info_cache with network_info: [{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d712c9d1-268a-48bf-bb92-91610e85c04f req-1824d94b-7393-42db-9fa7-ebad734673d3 service nova] Releasing lock "refresh_cache-da2d8479-bd97-40d2-9fea-e3a979b21a1f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:38 user nova-compute[75095]: INFO nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Rebuilding instance
Nov 15 15:44:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:39 user nova-compute[75095]: WARNING nova.compute.manager [req-44bfdac5-85c2-4edd-8293-839e4cdf93b2 req-345c6cc5-07b4-42ae-9978-824050f75d8c service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state active and task_state rebuilding.
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance destroyed successfully.
Nov 15 15:44:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance destroyed successfully.
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-503687833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e9fbda9-5b, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5bdec3b-8566-4bdb-93cd-25a961f297a5) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:39 user nova-compute[75095]: INFO os_vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b')
Nov 15 15:44:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:39 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eea258e-2c02-4f7d-943f-f5aa81f105d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:44:39 user nova-compute[75095]: No targets found.
Nov 15 15:44:39 user nova-compute[75095]: iSNS:
Nov 15 15:44:39 user nova-compute[75095]: No targets found.
Nov 15 15:44:39 user nova-compute[75095]: STATIC:
Nov 15 15:44:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:44:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:44:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b
Nov 15 15:44:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba
Nov 15 15:44:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:44:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:39 user nova-compute[75095]: FIRMWARE:
Nov 15 15:44:39 user nova-compute[75095]: No targets found.
Nov 15 15:44:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:44:39 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:44:39 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b115e2bf-d7b2-4320-b851-b58cbbdee164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e60b5f-8b28-4a35-a5d8-7b82d8297ce7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:39 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c66b880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3b2d51-9d66-40bd-9005-38a24e307e67]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3332cf72-e9f4-42ff-a17c-233e35f6bf93]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65d84bc-a9fd-4cee-a181-b4d798ccccc1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.199s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5153cc7-00e7-43a9-af88-ef60dcf471bd]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[453da358-12ea-4949-b02c-25be7f17be61]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a860c3a-49ef-4e41-9858-deccba4c56fe]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]
Nov 15 15:44:40 user nova-compute[75095]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dabbb5-9824-4f26-8768-80ba80dfbafb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.491s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== disconnect_volume: return (493ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:44:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deleting instance files /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f_del
Nov 15 15:44:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deletion of /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f_del complete
Nov 15 15:44:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance da2d8479-bd97-40d2-9fea-e3a979b21a1f could not be found.
Nov 15 15:44:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:40 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[543018ed-1d27-4d4b-96ae-63aac6be7dcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:44:40 user nova-compute[75095]: No targets found.
Nov 15 15:44:40 user nova-compute[75095]: iSNS:
Nov 15 15:44:40 user nova-compute[75095]: No targets found.
Nov 15 15:44:40 user nova-compute[75095]: STATIC:
Nov 15 15:44:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:44:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b
Nov 15 15:44:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba
Nov 15 15:44:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:44:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:40 user nova-compute[75095]: FIRMWARE:
Nov 15 15:44:40 user nova-compute[75095]: No targets found.
Nov 15 15:44:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:44:40 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:44:40 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b53b09-e026-4729-b87c-67fceb9f8f86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54752ee-026e-4bbd-98bd-cd85f5305896]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:40 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c5701f0>, {}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Disconnecting from: [] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== disconnect_volume: return (76ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptnBRzlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:41 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:41 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:41 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbed0a5-2b3e-4683-8223-38e021ffa3b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:44:41 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59163b34-9323-4a49-add7-0507ebed5d3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7] added
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb3caa-0667-4b82-9b3f-5f06cd76884d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4903fe-268b-4300-8878-181b6e204e32]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptnBRzlD {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ptnBRzlD" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99043b0-d2b3-4959-ad0a-0eb95a46decf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ptnBRzlD'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86649e73-ee44-46fb-9834-f55821bdc6ec]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:41 user nova-compute[75095]: WARNING nova.compute.manager [req-96b55ec3-2479-4c19-b42e-40d2804180be req-47c0f1a4-5690-4015-9914-05144c8e3731 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state active and task_state rebuilding.
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d959803-862d-471a-9e70-2a71be5f959d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XimpqLlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:41 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Preparing to wait for external event volume-reimaged-9c7f5944-102a-48ee-a60e-976f2b73357d {{(pid=75095) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e64bcb-b65f-487d-95a9-0f4f3aa062af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260]
Nov 15 15:44:41 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b239ad9c-cf1e-4458-acfe-83a6d67495e3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c047a8-bb48-45d9-bb7d-af9636b4dee2]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:41 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf477f08-4e08-4e50-bd18-c8de3caca815]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptnBRzlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26639646331623861', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639646331623861', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.134s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:42 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c5443-e405-4a28-a3d9-367a6c8b8adb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:44:42 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:44:42 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:42 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:44:42 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:42 user nova-compute[75095]:   <serial>11b808da-46fa-464b-9c70-6290d08f23c7</serial>
Nov 15 15:44:42 user nova-compute[75095]: </disk>
Nov 15 15:44:42 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6634ff-8786-43b7-87b6-0a0728380602]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d] added
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50065db6-4ff3-4c68-a445-1289377d1294]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d113f533-5e2f-4c6f-b68f-a8e5de8ad763]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XimpqLlZ {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XimpqLlZ" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a12825-0316-4a88-8ba1-eeb60f443169]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XimpqLlZ'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0af9753-651a-4b14-8a40-5618bf5f2687]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92d610-c4f2-4b6a-9685-9962f2e336c0]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf7e1f6-a1d4-41f1-8b69-e54182aaba25]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260]
Nov 15 15:44:42 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b523aa74-a1c9-4663-ae00-d8a67e71fd14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e27053-1a40-4ac3-a5d4-389b5f9bb513]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:42 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf1d04-a3e0-4f0b-b9b4-73b9de40084c]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XimpqLlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No BDM found with device name hda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] No VIF found with MAC fa:16:3e:36:9f:cd, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7ee1bba3-1987-4e05-96da-67476a6a961b tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.131s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] <== connect_volume: return (2485ms) {'type': 'block', 'scsi_wwn': '23638633737363532', 'path': '/dev/sdg'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638633737363532', 'path': '/dev/sdg'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.objects.instance [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lazy-loading 'flavor' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 15:44:43 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:43 user nova-compute[75095]:   <source dev="/dev/sdg"/>
Nov 15 15:44:43 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:43 user nova-compute[75095]:   <serial>dfe5f380-ce03-4772-bde8-1798f386583d</serial>
Nov 15 15:44:43 user nova-compute[75095]: </disk>
Nov 15 15:44:43 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] No VIF found with MAC fa:16:3e:57:b3:e4, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:44 user nova-compute[75095]: INFO nova.compute.manager [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Detaching volume 11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:44:44 user nova-compute[75095]: INFO nova.virt.block_device [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Attempting to driver detach volume 11b808da-46fa-464b-9c70-6290d08f23c7 from mountpoint /dev/vdb
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Attempting to detach device vdb from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:44 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:44 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:44:44 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:44 user nova-compute[75095]:   <serial>11b808da-46fa-464b-9c70-6290d08f23c7</serial>
Nov 15 15:44:44 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 15:44:44 user nova-compute[75095]: </disk>
Nov 15 15:44:44 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully detached device vdb from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the persistent domain config.
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:44 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:44 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:44:44 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:44 user nova-compute[75095]:   <serial>11b808da-46fa-464b-9c70-6290d08f23c7</serial>
Nov 15 15:44:44 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 15:44:44 user nova-compute[75095]: </disk>
Nov 15 15:44:44 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4afca477-489b-4ea9-b71e-e2fd840c93a4 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.264s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:44 user nova-compute[75095]: INFO nova.compute.manager [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Terminating instance
Nov 15 15:44:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-unplugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] No waiting events found dispatching network-vif-unplugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-52c6e1e2-443f-4a6d-b75f-24546015683f req-94728ddd-e65f-4453-8366-009a6d5ea221 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-unplugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] volume_snapshot_create: create_info: {'snapshot_id': 'a6058b8a-2c12-4158-99dd-a6bb340aa104', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75095) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] snap xml: <domainsnapshot>
Nov 15 15:44:45 user nova-compute[75095]:   <disks>
Nov 15 15:44:45 user nova-compute[75095]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 15 15:44:45 user nova-compute[75095]:       <source file="/dev/new_file"/>
Nov 15 15:44:45 user nova-compute[75095]:     </disk>
Nov 15 15:44:45 user nova-compute[75095]:     <disk name="vda" snapshot="no"/>
Nov 15 15:44:45 user nova-compute[75095]:   </disks>
Nov 15 15:44:45 user nova-compute[75095]: </domainsnapshot>
Nov 15 15:44:45 user nova-compute[75095]:  {{(pid=75095) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] Lazy-loading 'system_metadata' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     rv = execute(f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     six.reraise(c, e, tb)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     raise value
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     rv = meth(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     self._volume_snapshot_create(context, instance, guest,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     rv = execute(f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     six.reraise(c, e, tb)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     raise value
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     rv = meth(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] 
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c1e74e15-2e62-4106-ba1e-ed22653abb99 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] volume_snapshot_delete: delete_info: {'volume_id': 'dfe5f380-ce03-4772-bde8-1798f386583d'} {{(pid=75095) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [None req-c1e74e15-2e62-4106-ba1e-ed22653abb99 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f]     if delete_info['type'] != 'qcow2':
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] KeyError: 'type'
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] 
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Instance destroyed successfully.
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lazy-loading 'resources' on Instance uuid 1d5375d6-c598-4233-9b6f-77d009100dc0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a6058b8a-2c12-4158-99dd-a6bb340aa104 could not be found.
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a6058b8a-2c12-4158-99dd-a6bb340aa104 could not be found. (HTTP 404) (Request-ID: req-ba95fe82-3fc9-484a-b5c6-55242de4245c)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a6058b8a-2c12-4158-99dd-a6bb340aa104 could not be found.
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver [None req-c1e74e15-2e62-4106-ba1e-ed22653abb99 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a28afd0b-1707-445e-920a-dacccde503e1)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 15:44:45 user nova-compute[75095]: ERROR nova.virt.libvirt.driver 
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-224702509',display_name='tempest-VolumesActionsTest-instance-224702509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-224702509',id=9,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-902qz0wq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:06Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=1d5375d6-c598-4233-9b6f-77d009100dc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "address": "fa:16:3e:68:84:77", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86eb0c5a-02", "ovs_interfaceid": "86eb0c5a-02eb-435e-8c57-30c888dbdd10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG os_vif [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86eb0c5a-02, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server [None req-63002d27-966e-419a-903d-506fefdcf6f5 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server 
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37a850dc-250a-48e3-b7f4-12738c708309) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server [None req-c1e74e15-2e62-4106-ba1e-ed22653abb99 tempest-VolumesAssistedSnapshotsTest-1915335455 tempest-VolumesAssistedSnapshotsTest-1915335455-project] Exception during message handling: KeyError: 'type'
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 15:44:45 user nova-compute[75095]: ERROR oslo_messaging.rpc.server 
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:45 user nova-compute[75095]: INFO os_vif [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:84:77,bridge_name='br-int',has_traffic_filtering=True,id=86eb0c5a-02eb-435e-8c57-30c888dbdd10,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86eb0c5a-02')
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Deleting instance files /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0_del
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Deletion of /opt/stack/data/nova/instances/1d5375d6-c598-4233-9b6f-77d009100dc0_del complete
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.compute.manager [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.compute.manager [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Detaching volume dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.block_device [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Attempting to driver detach volume dfe5f380-ce03-4772-bde8-1798f386583d from mountpoint /dev/vdb
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Attempting to detach device vdb from instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:45 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:45 user nova-compute[75095]:   <source dev="/dev/sdg"/>
Nov 15 15:44:45 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:45 user nova-compute[75095]:   <serial>dfe5f380-ce03-4772-bde8-1798f386583d</serial>
Nov 15 15:44:45 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:44:45 user nova-compute[75095]: </disk>
Nov 15 15:44:45 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Successfully detached device vdb from instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f from the persistent domain config.
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:44:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 15:44:45 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:45 user nova-compute[75095]:   <source dev="/dev/sdg"/>
Nov 15 15:44:45 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:45 user nova-compute[75095]:   <serial>dfe5f380-ce03-4772-bde8-1798f386583d</serial>
Nov 15 15:44:45 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:44:45 user nova-compute[75095]: </disk>
Nov 15 15:44:45 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:46 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Took 0.52 seconds to deallocate network for instance.
Nov 15 15:44:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:46 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Deleted allocations for instance 1d5375d6-c598-4233-9b6f-77d009100dc0
Nov 15 15:44:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:44:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-292b8401-620d-4a95-8122-025634b5794f tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.872s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] Acquiring lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] Lock "1d5375d6-c598-4233-9b6f-77d009100dc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] No waiting events found dispatching network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:47 user nova-compute[75095]: WARNING nova.compute.manager [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received unexpected event network-vif-plugged-86eb0c5a-02eb-435e-8c57-30c888dbdd10 for instance with vm_state deleted and task_state None.
Nov 15 15:44:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-abe2e70b-d0a3-4cb3-9479-f3a9dcefee9a req-6cc1ec07-cdc2-4484-b11e-6755ba293238 service nova] [instance: 1d5375d6-c598-4233-9b6f-77d009100dc0] Received event network-vif-deleted-86eb0c5a-02eb-435e-8c57-30c888dbdd10 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing instance network info cache due to event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] Acquiring lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] Acquired lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updated VIF entry in instance network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating instance_info_cache with network_info: [{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5732928-a3b6-4b8b-9e01-25d3600d5ebb req-bdb11f22-c5ff-4ddb-90ea-e901ab41c9d8 service nova] Releasing lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:49 user nova-compute[75095]: INFO nova.compute.manager [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Attaching volume a42a7806-6282-4f8c-9e61-23cc8628e26b to /dev/vdb
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.utils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1d5cf7-53df-45c9-9cff-9baa81dd5c3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc19012a-b265-4f1b-864e-f2544c2809eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[309d1d7d-861a-4c38-a5fd-6f7af1df716a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b5ab1c-4870-4270-8600-908ffd7edf02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:49 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da7e2d8-714f-41c0-9b67-69b4eb6b1224]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG os_brick.utils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:49 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating existing volume attachment record: a17401d9-0910-4e04-b8ac-260546eef296 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 is timed out.
Nov 15 15:44:53 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Successfully detached device sdc from instance 205e57b3-4d57-43b8-9fac-484a8511e1e8 from the live domain config.
Nov 15 15:44:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bsClzTRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:53 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d76d05-010c-4d7b-ad61-577dfc938cb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:44:53 user nova-compute[75095]: No targets found.
Nov 15 15:44:53 user nova-compute[75095]: iSNS:
Nov 15 15:44:53 user nova-compute[75095]: No targets found.
Nov 15 15:44:53 user nova-compute[75095]: STATIC:
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:44:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:44:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:44:53 user nova-compute[75095]: FIRMWARE:
Nov 15 15:44:53 user nova-compute[75095]: No targets found.
Nov 15 15:44:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:44:53 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:44:53 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b222945e-8f4e-41e4-89e0-4849cfb75832]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b3c220-a573-4481-8c56-b613484196e7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:53 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c466cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b'): ({'sdf'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Removing single pathed devices sdf {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7abac0-662b-4500-b37d-78d10f922291]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5219c91-cc72-4daf-af84-14c9c35d627b]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Flushing IO for device /dev/sdf {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de422fd-7666-4df5-bfa5-b7b3c945ef14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7242e74-03ea-488b-a982-465099cfaa73]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f989c22-51ba-46ab-8b5c-22644f47af0a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e6069-09c4-437b-991f-a5935106c7b1]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260]
Nov 15 15:44:53 user nova-compute[75095]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:215c525b-ac7b-4676-a4da-a15d68ba8e0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f2522-03fa-40ad-a7df-ee1f81cf5949]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] <== disconnect_volume: return (327ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:44:54 user nova-compute[75095]: DEBUG nova.objects.instance [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lazy-loading 'flavor' on Instance uuid 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a513703b-1198-45e2-89b1-e8354913e7ac tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.764s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b req-eccd3fc9-47ea-4426-8f3c-ab2469082b81 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event volume-reimaged-9c7f5944-102a-48ee-a60e-976f2b73357d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b req-eccd3fc9-47ea-4426-8f3c-ab2469082b81 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b req-eccd3fc9-47ea-4426-8f3c-ab2469082b81 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b req-eccd3fc9-47ea-4426-8f3c-ab2469082b81 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b req-eccd3fc9-47ea-4426-8f3c-ab2469082b81 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Processing event volume-reimaged-9c7f5944-102a-48ee-a60e-976f2b73357d {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqKaDIuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:44:55 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:44:55 user nova-compute[75095]: INFO nova.virt.block_device [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Booting with volume 9c7f5944-102a-48ee-a60e-976f2b73357d at /dev/vda
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a07af5-9c82-40e8-b20a-d8f9d5a1b6b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:44:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3882ef4c-03cc-42c7-b256-beca48471a50]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b] added
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.utils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e1296-b4b0-4e8c-a5f0-156eb3944316]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36dce3c-3c68-4962-8e9a-d9735979d18f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d8ce7-1902-46e7-b3ab-031bb91fa2bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqKaDIuf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afff4ea-f5c4-49ab-9cc4-25df2bfa6c35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AqKaDIuf" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cf93f2-9c44-4012-ae12-4004f620bd55]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AqKaDIuf'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebc1c4c-cd5e-4834-bf37-d3ea048f566f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[355fd17e-856c-4d5c-b085-1e00bb6bb656]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38040dc-9be9-45ba-aa33-b29ecc8399ef]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: INFO nova.compute.manager [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Terminating instance
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:44:55 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84aa35-1090-400e-b730-f93747c1ab65]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.utils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating existing volume attachment record: e8bb4910-35d2-4414-a6f3-d0f123d7671d {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42de868-79eb-4538-8637-58b37846e20c]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3f7745-9cef-4077-b7a5-777f94a4f976]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260]
Nov 15 15:44:55 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260] successful.
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac86b329-2395-4405-be8c-3cc879a320e1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bad533-5486-4a30-848c-5c2daff96f47]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:44:55 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:44:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eefbd7-a955-4d6a-b159-6a4aa81cae16]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-unplugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] No waiting events found dispatching network-vif-unplugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-fd2a3a71-1d1d-4f88-9f44-72efa2a9cddf req-33d99bdc-43bc-468a-9d97-562cdef82264 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-unplugged-79e10ded-1e90-48a9-8849-a5580ff15a8d for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:44:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Instance destroyed successfully.
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lazy-loading 'resources' on Instance uuid 205e57b3-4d57-43b8-9fac-484a8511e1e8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-969747710',display_name='tempest-AttachSCSIVolumeTestJSON-server-969747710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-969747710',id=5,image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2bZiQSX7zrhHgqI/o/BhkHljg8JFNdz9O+sxZEvdO+/ISjtHeHANwYeqjxEhkxOjUwrVrwdPA9KSm0+a4/7G0ToB0aHNXRSrZ7BqJG6SUHd5XpLa8tS9iLdOAvz9YzpA==',key_name='tempest-keypair-1802452636',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76dcdfe283a64fc08915a530582cf44c',ramdisk_id='',reservation_id='r-xsgggr3b',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='79edd7ff-4e14-4a3c-b02c-83af2b99a9db',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-432443087',owner_user_name='tempest-AttachSCSIVolumeTestJSON-432443087-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6bba667990d94f6c8608ca147b130224',uuid=205e57b3-4d57-43b8-9fac-484a8511e1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converting VIF {"id": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "address": "fa:16:3e:bb:92:8f", "network": {"id": "a9d6c281-5889-4bc7-81ec-e5f287597e7f", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-30722956-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76dcdfe283a64fc08915a530582cf44c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79e10ded-1e", "ovs_interfaceid": "79e10ded-1e90-48a9-8849-a5580ff15a8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG os_vif [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79e10ded-1e, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d40a9b0e-f843-4fc3-ad96-e556c6dddd79) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:44:56 user nova-compute[75095]: INFO os_vif [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:92:8f,bridge_name='br-int',has_traffic_filtering=True,id=79e10ded-1e90-48a9-8849-a5580ff15a8d,network=Network(a9d6c281-5889-4bc7-81ec-e5f287597e7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79e10ded-1e')
Nov 15 15:44:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Deleting instance files /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8_del
Nov 15 15:44:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Deletion of /opt/stack/data/nova/instances/205e57b3-4d57-43b8-9fac-484a8511e1e8_del complete
Nov 15 15:44:56 user nova-compute[75095]: INFO nova.compute.manager [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 15:44:56 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-changed-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing instance network info cache due to event network-changed-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] Acquiring lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] Acquired lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.network.neutron [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Refreshing network info cache for port 7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqKaDIuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23034366135653839', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034366135653839', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:44:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:44:56 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:44:56 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:44:56 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:44:56 user nova-compute[75095]:   <serial>a42a7806-6282-4f8c-9e61-23cc8628e26b</serial>
Nov 15 15:44:56 user nova-compute[75095]: </disk>
Nov 15 15:44:56 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No VIF found with MAC fa:16:3e:28:fb:82, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updated VIF entry in instance network info cache for port 7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-71c4a50e-a466-483b-8d94-f3b14f59aa27 req-20450e93-c3af-499e-a314-09c8cbe2df2b service nova] Releasing lock "refresh_cache-119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:44:57 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Took 0.88 seconds to deallocate network for instance.
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87ffac78-a741-48f6-bc9a-9b8914343cf9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.651s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:57 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Deleted allocations for instance 205e57b3-4d57-43b8-9fac-484a8511e1e8
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b363282-2bc6-47e5-bf69-9f87bf33a442 tempest-AttachSCSIVolumeTestJSON-432443087 tempest-AttachSCSIVolumeTestJSON-432443087-project-member] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] Acquiring lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] Lock "205e57b3-4d57-43b8-9fac-484a8511e1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] No waiting events found dispatching network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:57 user nova-compute[75095]: WARNING nova.compute.manager [req-dee069fd-f926-436c-915d-0fada5397c16 req-533c8a4d-756d-40e2-a9cf-52633cbdf6c8 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received unexpected event network-vif-plugged-79e10ded-1e90-48a9-8849-a5580ff15a8d for instance with vm_state deleted and task_state None.
Nov 15 15:44:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-ae145ca7-25c4-48c1-ade0-293b71cb766d req-80931bde-291e-4c25-acde-1d3a2ec35a69 service nova] [instance: 205e57b3-4d57-43b8-9fac-484a8511e1e8] Received event network-vif-deleted-79e10ded-1e90-48a9-8849-a5580ff15a8d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:59 user nova-compute[75095]: INFO nova.compute.manager [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Terminating instance
Nov 15 15:44:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-1b9d50c0-b123-4237-aee5-3622e3a67d4e req-1db9efd9-3436-4342-821a-cde6662ed90f service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:44:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2cee4037-bf8d-449b-8b4e-5a8e3dda4988 req-7f202b81-4718-4300-bbe2-d7e483101c1e service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: INFO nova.compute.manager [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Detaching volume a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:00 user nova-compute[75095]: INFO nova.virt.block_device [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Attempting to driver detach volume a42a7806-6282-4f8c-9e61-23cc8628e26b from mountpoint /dev/vdb
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Attempting to detach device vdb from instance 37f47320-be8b-4d7a-b8a2-228e4894f881 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:45:00 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:00 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:45:00 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:45:00 user nova-compute[75095]:   <serial>a42a7806-6282-4f8c-9e61-23cc8628e26b</serial>
Nov 15 15:45:00 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:45:00 user nova-compute[75095]: </disk>
Nov 15 15:45:00 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully detached device vdb from instance 37f47320-be8b-4d7a-b8a2-228e4894f881 from the persistent domain config.
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 37f47320-be8b-4d7a-b8a2-228e4894f881 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:45:00 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:00 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:45:00 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:45:00 user nova-compute[75095]:   <serial>a42a7806-6282-4f8c-9e61-23cc8628e26b</serial>
Nov 15 15:45:00 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:45:00 user nova-compute[75095]: </disk>
Nov 15 15:45:00 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:00 user nova-compute[75095]: WARNING nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a for instance with vm_state active and task_state deleting.
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-341fd64a-97b7-4ec0-81db-930b46620fd9 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:00 user nova-compute[75095]: WARNING nova.compute.manager [req-08c80ffd-583a-4310-a2af-621db65babe2 req-c0fa8ad6-f606-4143-9ffd-6a5d5855482d service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-341fd64a-97b7-4ec0-81db-930b46620fd9 for instance with vm_state active and task_state deleting.
Nov 15 15:45:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Instance destroyed successfully.
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lazy-loading 'resources' on Instance uuid 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ccbf7d7-ca, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ca37fe7-3e2f-4b4e-aa72-3b0b615dbf35) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:10:2c,bridge_name='br-int',has_traffic_filtering=True,id=7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2,network=Network(286fd67f-b287-4b65-bc26-0ac1f1f00fa4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ccbf7d7-ca')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00b97002-29, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa7a3851-68ac-49aa-a898-4158c78da885) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:45:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Creating image(s)
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Ensure instance console log exists: /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start _get_guest_xml network_info=[{"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'e8bb4910-35d2-4414-a6f3-d0f123d7671d', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da2d8479-bd97-40d2-9fea-e3a979b21a1f', 'attached_at': '', 'detached_at': '', 'volume_id': '9c7f5944-102a-48ee-a60e-976f2b73357d', 'serial': '9c7f5944-102a-48ee-a60e-976f2b73357d'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:68:35,bridge_name='br-int',has_traffic_filtering=True,id=00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap00b97002-29')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap36b7392d-38, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 15:45:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.objects.instance [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lazy-loading 'vcpu_model' on Instance uuid da2d8479-bd97-40d2-9fea-e3a979b21a1f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=656e6643-3b2a-41ab-b8d1-e1f51b7e1f23) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[43842136-2ecd-4d3e-8f5f-7496c0bcdf4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:45:01 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135d049-d1f9-4995-837d-7d50fe52f831]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d] added
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:2a:fe,bridge_name='br-int',has_traffic_filtering=True,id=36b7392d-3820-48a0-90d0-860fff179784,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap36b7392d-38')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "341fd64a-97b7-4ec0-81db-930b46620fd9", "address": "fa:16:3e:37:1d:d3", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap341fd64a-97", "ovs_interfaceid": "341fd64a-97b7-4ec0-81db-930b46620fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap341fd64a-97, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69ac2ef-7dee-474c-9110-ae2896634a1f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7ac944e-bac0-4d89-8b08-44600acd67a4) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[646d8bdc-301e-4fc5-81a3-7cc92b842f13]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbLheKox {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sbLheKox" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fba9a4-e130-492f-95e9-503745d6923c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sbLheKox'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:1d:d3,bridge_name='br-int',has_traffic_filtering=True,id=341fd64a-97b7-4ec0-81db-930b46620fd9,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap341fd64a-97')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00bc3fa6-3a, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2647c48-e87a-4269-978a-a22df87fd4a1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6a94239-b94e-483b-bd87-5e0500895e55) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeee626-41c9-48dd-9783-de04ebcbfb2b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:8f:bd,bridge_name='br-int',has_traffic_filtering=True,id=00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb,network=Network(4ace41b0-d8bb-466b-9962-202fb86db2df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00bc3fa6-3a')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda7231d3-71, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=513bc688-a49a-42c7-8c25-3c81190ff576) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:ff:83,bridge_name='br-int',has_traffic_filtering=True,id=da7231d3-714a-4a20-abc7-4334416a49aa,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda7231d3-71')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:43:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1215604240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1215604240',id=11,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJ84Mr9w5Av4ilzfStLP2XqqhjxW1GHjJiQrqoKe3nFextjaDXBknEMJJB3oxFF9RF5t20Bw7G/z+F9Blq5+oSNi92T/6qjLKpcBOejU964jKugo95Fb7Oqqb3QU0HYKA==',key_name='tempest-keypair-689312283',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bafd945af714722847dc1ddb5f4d83f',ramdisk_id='',reservation_id='r-ca017cz4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1051292866',owner_user_name='tempest-TaggedBootDevicesTest_v242-1051292866-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='311fd99d09fa4e05bc4bae8e36963106',uuid=119015ba-aff2-4f8c-8e0c-5b9bf58a9c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converting VIF {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb161bec2-6c, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f96bbf3-0956-4ada-978d-1be2f391fece) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:01 user nova-compute[75095]: INFO os_vif [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:2a:eb,bridge_name='br-int',has_traffic_filtering=True,id=b161bec2-6c63-465f-8d5a-d580fd93c43e,network=Network(3213d28c-08a4-47b0-9417-c263c56420f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb161bec2-6c')
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvkPIUEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec19016e-1d12-45d3-bbbe-a424758c112b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]
Nov 15 15:45:01 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6ede6e-79e8-47be-aa6b-05e47b64318d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 for instance with vm_state active and task_state deleting.
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-36b7392d-3820-48a0-90d0-860fff179784 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-36b7392d-3820-48a0-90d0-860fff179784 for instance with vm_state active and task_state deleting.
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-da7231d3-714a-4a20-abc7-4334416a49aa for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:01 user nova-compute[75095]: WARNING nova.compute.manager [req-e3369dab-192e-4c7c-b03e-da70be21f1ae req-982ca63e-e6ec-4007-bf9d-3609f2210a1b service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-da7231d3-714a-4a20-abc7-4334416a49aa for instance with vm_state active and task_state deleting.
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c20a04-f3ff-4704-ba46-9b9092486e3e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:01 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20804d9-b9fe-41e3-bf62-b1b54f84438c]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:45:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:02 user nova-compute[75095]: WARNING nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb for instance with vm_state active and task_state deleting.
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-unplugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-unplugged-b161bec2-6c63-465f-8d5a-d580fd93c43e for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Acquiring lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] No waiting events found dispatching network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:02 user nova-compute[75095]: WARNING nova.compute.manager [req-19828e8c-6822-4a7f-b622-81e180a4e96d req-99bfccfc-f189-4930-afc5-07b0e2887e62 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received unexpected event network-vif-plugged-b161bec2-6c63-465f-8d5a-d580fd93c43e for instance with vm_state active and task_state deleting.
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23266653730656530', 'path': '/dev/sdh'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266653730656530', 'path': '/dev/sdh'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.119s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-503687833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:45:02 user nova-compute[75095]:   <uuid>da2d8479-bd97-40d2-9fea-e3a979b21a1f</uuid>
Nov 15 15:45:02 user nova-compute[75095]:   <name>instance-00000008</name>
Nov 15 15:45:02 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:45:02 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:45:02 user nova-compute[75095]:   <metadata>
Nov 15 15:45:02 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:02 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:45:02 user nova-compute[75095]:       <nova:name>tempest-ServerActionsV293TestJSON-server-503687833</nova:name>
Nov 15 15:45:02 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:45:01</nova:creationTime>
Nov 15 15:45:02 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:45:02 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:02 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:45:02 user nova-compute[75095]:       <nova:owner>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:user uuid="967d134fe5cb41aaa8181e8372724dd7">tempest-ServerActionsV293TestJSON-454148145-project-member</nova:user>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:project uuid="1bae3e7bf05d46c48aab837a23446af4">tempest-ServerActionsV293TestJSON-454148145</nova:project>
Nov 15 15:45:02 user nova-compute[75095]:       </nova:owner>
Nov 15 15:45:02 user nova-compute[75095]:       <nova:ports>
Nov 15 15:45:02 user nova-compute[75095]:         <nova:port uuid="1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d">
Nov 15 15:45:02 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:45:02 user nova-compute[75095]:         </nova:port>
Nov 15 15:45:02 user nova-compute[75095]:       </nova:ports>
Nov 15 15:45:02 user nova-compute[75095]:     </nova:instance>
Nov 15 15:45:02 user nova-compute[75095]:   </metadata>
Nov 15 15:45:02 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:45:02 user nova-compute[75095]:     <system>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="serial">da2d8479-bd97-40d2-9fea-e3a979b21a1f</entry>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="uuid">da2d8479-bd97-40d2-9fea-e3a979b21a1f</entry>
Nov 15 15:45:02 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:45:02 user nova-compute[75095]:     </system>
Nov 15 15:45:02 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:02 user nova-compute[75095]:   <os>
Nov 15 15:45:02 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:45:02 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:45:02 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:45:02 user nova-compute[75095]:   </os>
Nov 15 15:45:02 user nova-compute[75095]:   <features>
Nov 15 15:45:02 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:02 user nova-compute[75095]:     <apic/>
Nov 15 15:45:02 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:45:02 user nova-compute[75095]:   </features>
Nov 15 15:45:02 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:45:02 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:45:02 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:45:02 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:45:02 user nova-compute[75095]:   </clock>
Nov 15 15:45:02 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:45:02 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:45:02 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:45:02 user nova-compute[75095]:   </cpu>
Nov 15 15:45:02 user nova-compute[75095]:   <devices>
Nov 15 15:45:02 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:45:02 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:02 user nova-compute[75095]:       <source dev="/dev/sdh"/>
Nov 15 15:45:02 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:45:02 user nova-compute[75095]:       <serial>9c7f5944-102a-48ee-a60e-976f2b73357d</serial>
Nov 15 15:45:02 user nova-compute[75095]:     </disk>
Nov 15 15:45:02 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:45:02 user nova-compute[75095]:       <mac address="fa:16:3e:85:8a:71"/>
Nov 15 15:45:02 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:02 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:45:02 user nova-compute[75095]:       <target dev="tap1e9fbda9-5b"/>
Nov 15 15:45:02 user nova-compute[75095]:     </interface>
Nov 15 15:45:02 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:45:02 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f/console.log" append="off"/>
Nov 15 15:45:02 user nova-compute[75095]:     </serial>
Nov 15 15:45:02 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:45:02 user nova-compute[75095]:     <video>
Nov 15 15:45:02 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:02 user nova-compute[75095]:     </video>
Nov 15 15:45:02 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:45:02 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:45:02 user nova-compute[75095]:     </rng>
Nov 15 15:45:02 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:45:02 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:45:02 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:45:02 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:02 user nova-compute[75095]:   </devices>
Nov 15 15:45:02 user nova-compute[75095]: </domain>
Nov 15 15:45:02 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-503687833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a71a02-329e-48c5-b123-6a3357601b89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]: iSNS:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]: STATIC:
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:02 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:02 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '36981f1c-d4d8-5d30-8153-c4ce0bc0eaec', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e9fbda9-5b, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e9fbda9-5b, col_values=(('qos', UUID('96b14c26-511e-4621-84b3-95a2ca77101e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e9fbda9-5b, col_values=(('external_ids', {'iface-id': '1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:8a:71', 'vm-uuid': 'da2d8479-bd97-40d2-9fea-e3a979b21a1f'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:02 user nova-compute[75095]: INFO os_vif [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b')
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ef4790-bee7-4731-a288-06c5a81ae1fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53748e84-c9e2-49d5-b1aa-a11e5c821837]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:02 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c14bd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de42799-2d21-4a29-b724-29d50e508707]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4235ab24-0f10-43d2-b8b4-208e9b986c97]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5d07ce-4320-409d-bd74-882d317143f7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] No VIF found with MAC fa:16:3e:85:8a:71, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e79050-04ae-4eec-8290-a3b7c6f5c0da]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b087a9-96f2-4ca9-8654-eeef39d125f1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b036ae2-da7c-451f-9ef6-0592ce6d50ca]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260]
Nov 15 15:45:02 user nova-compute[75095]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfa3eb6-9ee2-4c96-a742-309e7cde3eba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd42d7d2-4b27-486b-adce-d0b0d06a8484]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== disconnect_volume: return (1463ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bpfTBQNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:02 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[421712bb-3923-4e23-8fc6-6fc7d61ed66f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]: iSNS:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]: STATIC:
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:45:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:02 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:02 user nova-compute[75095]: No targets found.
Nov 15 15:45:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:02 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:02 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4aba10-dac6-410a-8d4c-f0d7c75d76fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db81c46-4b9b-468d-a29f-31b50e640edb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c467eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5c97e5-07d6-42b4-bb98-ada5564ad2b3]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d528632-127e-4c5d-94dd-6bc84a0a63f8]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ac689-62e2-4969-b59b-b00c5e417551]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db660dca-df4d-4c48-9469-0fcec1ad49e3]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b742a5c0-ba2f-49de-85b0-bc9f08344880]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb833b8f-e222-4d08-81f9-d15216d4bdf7]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260]
Nov 15 15:45:03 user nova-compute[75095]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1db461bf-3c73-4187-87e9-7ab73edb728b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac5d76-3622-4714-8093-baae88f6bf11]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== disconnect_volume: return (323ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lykTioBg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:03 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[478c72e3-de2a-4c49-86be-04c71d4af543]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:03 user nova-compute[75095]: No targets found.
Nov 15 15:45:03 user nova-compute[75095]: iSNS:
Nov 15 15:45:03 user nova-compute[75095]: No targets found.
Nov 15 15:45:03 user nova-compute[75095]: STATIC:
Nov 15 15:45:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd
Nov 15 15:45:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:45:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:45:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:03 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:03 user nova-compute[75095]: No targets found.
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:03 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:03 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d3e809-53e7-4ed2-8f7d-455dad711327]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe3f6ee-12e3-4031-87a9-cfc01994c02e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:03 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c467eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a4894-4c69-40ec-a01e-5b0cb4e54988]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafa419f-a9b3-454d-8ba0-c7b4f5968878]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b633d8-b095-4b37-8d34-09661545fe14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6cc9803-df41-40d7-ae87-6addebc32637]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c17d3cf-0559-4fc5-8890-6eba0f3eae75]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b12237-302f-4463-a0a0-5673949bbd30]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260]
Nov 15 15:45:03 user nova-compute[75095]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0773b155-9f8e-43af-a64c-436492b997bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f64f9-5ca8-4368-93a4-9110a209d270]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] <== disconnect_volume: return (315ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Deleting instance files /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72_del
Nov 15 15:45:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Deletion of /opt/stack/data/nova/instances/119015ba-aff2-4f8c-8e0c-5b9bf58a9c72_del complete
Nov 15 15:45:03 user nova-compute[75095]: INFO nova.compute.manager [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Took 4.56 seconds to destroy the instance on the hypervisor.
Nov 15 15:45:03 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:45:03 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:04 user nova-compute[75095]: WARNING nova.compute.manager [req-1bf0d34e-b13b-476a-a7c8-724421822858 req-a5022150-7434-42cd-b89c-e0e859d9bfb1 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state active and task_state rebuild_spawning.
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:05 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 82cf5365-8116-43dc-adcf-58006b301b6b is timed out.
Nov 15 15:45:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully detached device vdb from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the live domain config.
Nov 15 15:45:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ptnBRzlD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:05 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cd225e-b97a-4178-93ba-d47397f671c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:05 user nova-compute[75095]: No targets found.
Nov 15 15:45:05 user nova-compute[75095]: iSNS:
Nov 15 15:45:05 user nova-compute[75095]: No targets found.
Nov 15 15:45:05 user nova-compute[75095]: STATIC:
Nov 15 15:45:05 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:05 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:05 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:05 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:05 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:05 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:05 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7
Nov 15 15:45:05 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:05 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:05 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:45:05 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:05 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:05 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:05 user nova-compute[75095]: No targets found.
Nov 15 15:45:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:05 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:05 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a12cf9-bbfd-49f3-9e22-09cad3fdc68c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e8ccb5-be5b-4219-8a2a-279bb2146217]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 (non-flash)
Nov 15 15:45:05 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3de710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[553aae31-184e-49ea-b6e2-b492937015d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62377f-3e91-4319-816c-52f968959401]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2014aba0-aebe-446b-9442-32d7f7936268]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d19f8-1121-45b5-aaf5-61367fd45a7a]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7820f32a-4162-47fc-9dba-fb166a4b4d29]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bd8dc2-4f2d-4a28-9ef2-39b9471d41c1]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260]
Nov 15 15:45:05 user nova-compute[75095]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-5fcfafb4-26fa-42a9-bbec-582555a36eb4 req-7cd47bee-3cb4-4d0d-b44e-877491c8829a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-deleted-341fd64a-97b7-4ec0-81db-930b46620fd9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:05 user nova-compute[75095]: INFO nova.compute.manager [req-5fcfafb4-26fa-42a9-bbec-582555a36eb4 req-7cd47bee-3cb4-4d0d-b44e-877491c8829a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Neutron deleted interface 341fd64a-97b7-4ec0-81db-930b46620fd9; detaching it from the instance and deleting it from the info cache
Nov 15 15:45:05 user nova-compute[75095]: DEBUG nova.network.neutron [req-5fcfafb4-26fa-42a9-bbec-582555a36eb4 req-7cd47bee-3cb4-4d0d-b44e-877491c8829a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [{"id": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "address": "fa:16:3e:46:10:2c", "network": {"id": "286fd67f-b287-4b65-bc26-0ac1f1f00fa4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1372343270-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ccbf7d7-ca", "ovs_interfaceid": "7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "address": "fa:16:3e:cf:68:35", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00b97002-29", "ovs_interfaceid": "00b97002-29d7-4dbd-b1fc-cb5e8a1e5c9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "36b7392d-3820-48a0-90d0-860fff179784", "address": "fa:16:3e:60:2a:fe", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.88", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap36b7392d-38", "ovs_interfaceid": "36b7392d-3820-48a0-90d0-860fff179784", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "address": "fa:16:3e:e6:8f:bd", "network": {"id": "4ace41b0-d8bb-466b-9962-202fb86db2df", "bridge": "br-int", "label": "tempest-device-tagging-net1-34583691", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00bc3fa6-3a", "ovs_interfaceid": "00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da7231d3-714a-4a20-abc7-4334416a49aa", "address": "fa:16:3e:d6:ff:83", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda7231d3-71", "ovs_interfaceid": "da7231d3-714a-4a20-abc7-4334416a49aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "address": "fa:16:3e:a7:2a:eb", "network": {"id": "3213d28c-08a4-47b0-9417-c263c56420f6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1874050855", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2bafd945af714722847dc1ddb5f4d83f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb161bec2-6c", "ovs_interfaceid": "b161bec2-6c63-465f-8d5a-d580fd93c43e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11b808da-46fa-464b-9c70-6290d08f23c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[633c20ca-a756-4373-bf73-7c69f9b54d6b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] <== disconnect_volume: return (310ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-5fcfafb4-26fa-42a9-bbec-582555a36eb4 req-7cd47bee-3cb4-4d0d-b44e-877491c8829a service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Detach interface failed, port_id=341fd64a-97b7-4ec0-81db-930b46620fd9, reason: Instance 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 15:45:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:45:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance spawned successfully.
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-37041c36-ac79-48b3-bf17-22eb698c4a05 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:06 user nova-compute[75095]: WARNING nova.compute.manager [req-bee771d1-91e7-4917-a2be-9ee1f9be0569 req-768a4859-6763-41f0-aef8-3c26871ed7c8 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state active and task_state rebuild_spawning.
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:45:06 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f is timed out.
Nov 15 15:45:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Successfully detached device vdb from instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f from the live domain config.
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XimpqLlZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:06 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75095) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22e4a99-bc15-4fd2-bb13-0d6a5c304c53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:06 user nova-compute[75095]: No targets found.
Nov 15 15:45:06 user nova-compute[75095]: iSNS:
Nov 15 15:45:06 user nova-compute[75095]: No targets found.
Nov 15 15:45:06 user nova-compute[75095]: STATIC:
Nov 15 15:45:06 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:06 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:06 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:06 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:06 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:06 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:06 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d
Nov 15 15:45:06 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:06 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:06 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:06 user nova-compute[75095]: No targets found.
Nov 15 15:45:06 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:06 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:06 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67de5cee-ca90-4f68-8f7f-c6fd6e363945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5897ef-6704-49fc-98b3-c417a208c93f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:06 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:06 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:06 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:06 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:06 user nova-compute[75095]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d (non-flash)
Nov 15 15:45:06 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d'): ({'sdg'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Removing single pathed devices sdg {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-979d49d1-8ab8-4ad0-a9b7-33f8764a071b tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.097s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b95fef-c8bb-4d18-bc7e-8224ea2bb234]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b004105-11e2-4791-89a5-348e92bcff25]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Flushing IO for device /dev/sdg {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8834744-f490-48cb-a49a-fe7e7631398c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbf8e30-5836-4d0d-814c-9a2dc2f27dce]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] SCSI volumes sdg have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3a5ff-d8a7-4200-86b0-91d03244eb25]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f57ae33-5fab-4f7c-bd55-534d0207e2b4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260]
Nov 15 15:45:06 user nova-compute[75095]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:06 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfe5f380-ce03-4772-bde8-1798f386583d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f097e5aa-8dcf-42a0-99cd-bb60709b8fc0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] <== disconnect_volume: return (324ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:06 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Took 3.26 seconds to deallocate network for instance.
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-b49e134b-013a-4df1-92bf-fc794a88d5d6" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-b49e134b-013a-4df1-92bf-fc794a88d5d6" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Attempting to detach device tapb49e134b-01 from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] detach device xml: <interface type="ethernet">
Nov 15 15:45:07 user nova-compute[75095]:   <mac address="fa:16:3e:8b:f8:bd"/>
Nov 15 15:45:07 user nova-compute[75095]:   <model type="virtio"/>
Nov 15 15:45:07 user nova-compute[75095]:   <mtu size="1442"/>
Nov 15 15:45:07 user nova-compute[75095]:   <target dev="tapb49e134b-01"/>
Nov 15 15:45:07 user nova-compute[75095]: </interface>
Nov 15 15:45:07 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 15:45:07 user nova-compute[75095]:   <name>instance-00000006</name>
Nov 15 15:45:07 user nova-compute[75095]:   <uuid>82cf5365-8116-43dc-adcf-58006b301b6b</uuid>
Nov 15 15:45:07 user nova-compute[75095]:   <metadata>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:07 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:44:35</nova:creationTime>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:07 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:07 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:07 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:07 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:07 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:07 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:07 user nova-compute[75095]:     <nova:port uuid="b49e134b-013a-4df1-92bf-fc794a88d5d6">
Nov 15 15:45:07 user nova-compute[75095]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Nov 15 15:45:07 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:07 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:07 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:07 user nova-compute[75095]:   </metadata>
Nov 15 15:45:07 user nova-compute[75095]:   <memory unit='KiB'>524288</memory>
Nov 15 15:45:07 user nova-compute[75095]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 15:45:07 user nova-compute[75095]:   <vcpu placement='static'>1</vcpu>
Nov 15 15:45:07 user nova-compute[75095]:   <resource>
Nov 15 15:45:07 user nova-compute[75095]:     <partition>/machine</partition>
Nov 15 15:45:07 user nova-compute[75095]:   </resource>
Nov 15 15:45:07 user nova-compute[75095]:   <sysinfo type='smbios'>
Nov 15 15:45:07 user nova-compute[75095]:     <system>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='version'>0.0.0</entry>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='serial'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='uuid'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:07 user nova-compute[75095]:       <entry name='family'>Virtual Machine</entry>
Nov 15 15:45:07 user nova-compute[75095]:     </system>
Nov 15 15:45:07 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:07 user nova-compute[75095]:   <os>
Nov 15 15:45:07 user nova-compute[75095]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 15:45:07 user nova-compute[75095]:     <boot dev='hd'/>
Nov 15 15:45:07 user nova-compute[75095]:     <smbios mode='sysinfo'/>
Nov 15 15:45:07 user nova-compute[75095]:   </os>
Nov 15 15:45:07 user nova-compute[75095]:   <features>
Nov 15 15:45:07 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:07 user nova-compute[75095]:     <apic/>
Nov 15 15:45:07 user nova-compute[75095]:     <vmcoreinfo state='on'/>
Nov 15 15:45:07 user nova-compute[75095]:   </features>
Nov 15 15:45:07 user nova-compute[75095]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 15:45:07 user nova-compute[75095]:     <model fallback='forbid'>Nehalem</model>
Nov 15 15:45:07 user nova-compute[75095]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 15:45:07 user nova-compute[75095]:     <feature policy='require' name='vme'/>
Nov 15 15:45:07 user nova-compute[75095]:     <feature policy='require' name='x2apic'/>
Nov 15 15:45:07 user nova-compute[75095]:     <feature policy='require' name='hypervisor'/>
Nov 15 15:45:07 user nova-compute[75095]:   </cpu>
Nov 15 15:45:07 user nova-compute[75095]:   <clock offset='utc'>
Nov 15 15:45:07 user nova-compute[75095]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 15:45:07 user nova-compute[75095]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 15:45:07 user nova-compute[75095]:     <timer name='hpet' present='no'/>
Nov 15 15:45:07 user nova-compute[75095]:   </clock>
Nov 15 15:45:07 user nova-compute[75095]:   <on_poweroff>destroy</on_poweroff>
Nov 15 15:45:07 user nova-compute[75095]:   <on_reboot>restart</on_reboot>
Nov 15 15:45:07 user nova-compute[75095]:   <on_crash>destroy</on_crash>
Nov 15 15:45:07 user nova-compute[75095]:   <devices>
Nov 15 15:45:07 user nova-compute[75095]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 15:45:07 user nova-compute[75095]:     <disk type='file' device='disk'>
Nov 15 15:45:07 user nova-compute[75095]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 15:45:07 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk' index='2'/>
Nov 15 15:45:07 user nova-compute[75095]:       <backingStore type='file' index='3'>
Nov 15 15:45:07 user nova-compute[75095]:         <format type='raw'/>
Nov 15 15:45:07 user nova-compute[75095]:         <source file='/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003'/>
Nov 15 15:45:07 user nova-compute[75095]:         <backingStore/>
Nov 15 15:45:07 user nova-compute[75095]:       </backingStore>
Nov 15 15:45:07 user nova-compute[75095]:       <target dev='vda' bus='virtio'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='virtio-disk0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </disk>
Nov 15 15:45:07 user nova-compute[75095]:     <disk type='file' device='cdrom'>
Nov 15 15:45:07 user nova-compute[75095]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 15:45:07 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config' index='1'/>
Nov 15 15:45:07 user nova-compute[75095]:       <backingStore/>
Nov 15 15:45:07 user nova-compute[75095]:       <target dev='hda' bus='ide'/>
Nov 15 15:45:07 user nova-compute[75095]:       <readonly/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='ide0-0-0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </disk>
Nov 15 15:45:07 user nova-compute[75095]:     <controller type='usb' index='0' model='none'>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='usb'/>
Nov 15 15:45:07 user nova-compute[75095]:     </controller>
Nov 15 15:45:07 user nova-compute[75095]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='pci.0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </controller>
Nov 15 15:45:07 user nova-compute[75095]:     <controller type='ide' index='0'>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='ide'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 15:45:07 user nova-compute[75095]:     </controller>
Nov 15 15:45:07 user nova-compute[75095]:     <interface type='ethernet'>
Nov 15 15:45:07 user nova-compute[75095]:       <mac address='fa:16:3e:36:9f:cd'/>
Nov 15 15:45:07 user nova-compute[75095]:       <target dev='tap6114f792-10'/>
Nov 15 15:45:07 user nova-compute[75095]:       <model type='virtio'/>
Nov 15 15:45:07 user nova-compute[75095]:       <mtu size='1442'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='net0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </interface>
Nov 15 15:45:07 user nova-compute[75095]:     <interface type='ethernet'>
Nov 15 15:45:07 user nova-compute[75095]:       <mac address='fa:16:3e:8b:f8:bd'/>
Nov 15 15:45:07 user nova-compute[75095]:       <target dev='tapb49e134b-01'/>
Nov 15 15:45:07 user nova-compute[75095]:       <model type='virtio'/>
Nov 15 15:45:07 user nova-compute[75095]:       <mtu size='1442'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='net1'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </interface>
Nov 15 15:45:07 user nova-compute[75095]:     <serial type='pty'>
Nov 15 15:45:07 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:07 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:07 user nova-compute[75095]:       <target type='isa-serial' port='0'>
Nov 15 15:45:07 user nova-compute[75095]:         <model name='isa-serial'/>
Nov 15 15:45:07 user nova-compute[75095]:       </target>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </serial>
Nov 15 15:45:07 user nova-compute[75095]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 15:45:07 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:07 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:07 user nova-compute[75095]:       <target type='serial' port='0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </console>
Nov 15 15:45:07 user nova-compute[75095]:     <input type='mouse' bus='ps2'>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='input0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </input>
Nov 15 15:45:07 user nova-compute[75095]:     <input type='keyboard' bus='ps2'>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='input1'/>
Nov 15 15:45:07 user nova-compute[75095]:     </input>
Nov 15 15:45:07 user nova-compute[75095]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 15:45:07 user nova-compute[75095]:       <listen type='address' address='0.0.0.0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </graphics>
Nov 15 15:45:07 user nova-compute[75095]:     <audio id='1' type='none'/>
Nov 15 15:45:07 user nova-compute[75095]:     <video>
Nov 15 15:45:07 user nova-compute[75095]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='video0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </video>
Nov 15 15:45:07 user nova-compute[75095]:     <memballoon model='virtio'>
Nov 15 15:45:07 user nova-compute[75095]:       <stats period='10'/>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='balloon0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:07 user nova-compute[75095]:     <rng model='virtio'>
Nov 15 15:45:07 user nova-compute[75095]:       <backend model='random'>/dev/urandom</backend>
Nov 15 15:45:07 user nova-compute[75095]:       <alias name='rng0'/>
Nov 15 15:45:07 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 15:45:07 user nova-compute[75095]:     </rng>
Nov 15 15:45:07 user nova-compute[75095]:   </devices>
Nov 15 15:45:07 user nova-compute[75095]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 15:45:07 user nova-compute[75095]:     <label>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</label>
Nov 15 15:45:07 user nova-compute[75095]:     <imagelabel>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</imagelabel>
Nov 15 15:45:07 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:07 user nova-compute[75095]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 15:45:07 user nova-compute[75095]:     <label>+64055:+108</label>
Nov 15 15:45:07 user nova-compute[75095]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 15:45:07 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:07 user nova-compute[75095]: </domain>
Nov 15 15:45:07 user nova-compute[75095]:  {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 15:45:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully detached device tapb49e134b-01 from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the persistent domain config.
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] (1/8): Attempting to detach device tapb49e134b-01 with device alias net1 from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] detach device xml: <interface type="ethernet">
Nov 15 15:45:07 user nova-compute[75095]:   <mac address="fa:16:3e:8b:f8:bd"/>
Nov 15 15:45:07 user nova-compute[75095]:   <model type="virtio"/>
Nov 15 15:45:07 user nova-compute[75095]:   <mtu size="1442"/>
Nov 15 15:45:07 user nova-compute[75095]:   <target dev="tapb49e134b-01"/>
Nov 15 15:45:07 user nova-compute[75095]: </interface>
Nov 15 15:45:07 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-f31f3af3-7fea-4f70-90da-212d2abb312f req-ae8bbd95-2002-44ef-910a-d5f2518bd918 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-deleted-b161bec2-6c63-465f-8d5a-d580fd93c43e {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-f31f3af3-7fea-4f70-90da-212d2abb312f req-ae8bbd95-2002-44ef-910a-d5f2518bd918 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-deleted-da7231d3-714a-4a20-abc7-4334416a49aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-f31f3af3-7fea-4f70-90da-212d2abb312f req-ae8bbd95-2002-44ef-910a-d5f2518bd918 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-deleted-7ccbf7d7-ca79-4e17-9ef7-ff3e3914dbc2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-f31f3af3-7fea-4f70-90da-212d2abb312f req-ae8bbd95-2002-44ef-910a-d5f2518bd918 service nova] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Received event network-vif-deleted-00bc3fa6-3a51-4901-8eb6-d2c59c4c5edb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Start waiting for the detach event from libvirt for device tapb49e134b-01 with device alias net1 for instance 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lazy-loading 'flavor' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bf2a923b-cea5-4acd-956b-1863f34f58a2 tempest-VolumesAssistedSnapshotsTest-960246368 tempest-VolumesAssistedSnapshotsTest-960246368-project-admin] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-changed-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Refreshing instance network info cache due to event network-changed-775042fd-5cb9-4d4a-827c-85f47018d977. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] Acquiring lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] Acquired lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Refreshing network info cache for port 775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-unplugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-unplugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:08 user nova-compute[75095]: WARNING nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-unplugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 for instance with vm_state active and task_state None.
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:08 user nova-compute[75095]: WARNING nova.compute.manager [req-5c490140-3059-4d6b-9d56-7a2054fae1c7 req-ecd9ff19-c255-4359-a128-21ec3ff55f39 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-b49e134b-013a-4df1-92bf-fc794a88d5d6 for instance with vm_state active and task_state None.
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updated VIF entry in instance network info cache for port 775042fd-5cb9-4d4a-827c-85f47018d977. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating instance_info_cache with network_info: [{"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5debeb-8f66-4120-b948-702fd488b5d6 req-fc58fe43-a902-4eb1-b9d4-8e885763b183 service nova] Releasing lock "refresh_cache-842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.341s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:09 user nova-compute[75095]: INFO nova.compute.manager [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attaching volume 8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd to /dev/vdb
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG os_brick.utils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c7945e-d57e-4b37-8519-f771c583b098]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed4697-5ef7-49b6-b62e-83263e32cabc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d83e4c-49bc-4cd9-816c-45518c5f696c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fba8fe-1857-4596-8bf8-6f35a7daac6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:10 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f0a5fb-6550-4537-80dc-c126f00f0b2d]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG os_brick.utils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating existing volume attachment record: 40b48027-4b57-488f-9a5e-4738c8ac3cf5 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:45:10 user nova-compute[75095]: INFO nova.compute.manager [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] [instance: 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72] Took 3.10 seconds to detach 3 volumes for instance.
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:10 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Deleted allocations for instance 119015ba-aff2-4f8c-8e0c-5b9bf58a9c72
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9012e1f-c033-433b-ba30-e6b2733f76b5 tempest-TaggedBootDevicesTest_v242-1051292866 tempest-TaggedBootDevicesTest_v242-1051292866-project-member] Lock "119015ba-aff2-4f8c-8e0c-5b9bf58a9c72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.649s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'flavor' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:11 user nova-compute[75095]: INFO nova.compute.manager [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Attaching volume fa151bd9-2d9d-4dc2-b38a-86c933895386 to /dev/vdb
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.utils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb389e3d-a6b2-4855-bbdc-85ab549d8ee3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffd68e4-b806-441e-9349-f19d48fa3538]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c7448-9312-4f7a-b9e3-2ad67c659f22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fe5cb4-b696-4b51-abaf-23fdae19a8f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:11 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21c07e-6987-4336-929e-d99cb7e45b9c]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG os_brick.utils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating existing volume attachment record: c02339e8-716b-489c-b8eb-10c0c6ca4792 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7586MB free_disk=24.77472686767578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82cf5365-8116-43dc-adcf-58006b301b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance da2d8479-bd97-40d2-9fea-e3a979b21a1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:45:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:45:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUjcezVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:15 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:15 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:15 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb0228-c552-4cc4-9b2e-a6a379eafee2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:45:15 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e11d8c-59ca-4c7e-b5a7-9a3b9c0e5544]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd] added
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a77669-b3b0-43aa-b5be-701feb9aa6c4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f9975-5bff-4feb-b79a-ac8eaeb602d9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUjcezVH {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUjcezVH" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d53ea-b7b4-4000-bffb-a1450ee3e2e7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUjcezVH'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb74b3b8-7726-4be2-aa1b-272f25cfdc96]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f1fbb-014b-45a8-956a-9dc701377fb1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ae24f-f03c-47c1-9125-ee5350750476]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260]
Nov 15 15:45:15 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e50c195-769b-4cb5-9727-4507700b0954]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aae006-2be3-4a0f-8587-b49f420bf7ab]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:15 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92209d84-8dce-40e9-999c-625ea0fd57fe]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUjcezVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:45:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23634353933313061', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634353933313061', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:45:16 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:16 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:45:16 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:45:16 user nova-compute[75095]:   <serial>8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd</serial>
Nov 15 15:45:16 user nova-compute[75095]: </disk>
Nov 15 15:45:16 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:16 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:16 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:16 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d9649-abab-460e-9995-fc2094266513]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:45:16 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11381e-b2ad-4a5c-b5af-d7306dc42e8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added
Nov 15 15:45:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fc04e4-b097-45c1-ab64-3687e69a5ecf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8973a4-0738-4307-aa20-86d8d5352050]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f59ea-06ab-46de-adc9-34b98804f1e0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byrQvwYn'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No VIF found with MAC fa:16:3e:84:38:51, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe2ddd4-25ac-4cbe-9cc0-bb316f27b216]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3921740-ea82-4381-a05f-56ca4a5e807a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:16 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:16 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:16 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:16 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda93b11-2989-4fc3-9705-de50a70dee9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:45:17 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c474f-57d7-4245-add8-1ad81c598c73]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f7d0525f-e4a6-4991-acf3-19a9c253fa20 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.265s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dfd083-8ff5-499d-9c1c-212d662bdfe8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:17 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791631b-2aae-4bfa-8cce-45cb0c5f7e55]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'flavor' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:45:18 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:18 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:45:18 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:45:18 user nova-compute[75095]:   <serial>fa151bd9-2d9d-4dc2-b38a-86c933895386</serial>
Nov 15 15:45:18 user nova-compute[75095]: </disk>
Nov 15 15:45:18 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No VIF found with MAC fa:16:3e:56:ec:23, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f6fdc8dc-5f43-4aba-8011-c0803929a70f tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.300s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:45:19 user nova-compute[75095]: INFO nova.compute.claims [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Claim successful on node user
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:45:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.policy [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e464dcfa23814b2798c8738730374dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146bfea92e9f4bf3b6996aac094f9e43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:45:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Creating image(s)
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "/opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk 1073741824" returned: 0 in 0.134s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.245s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Cannot resize image /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Ensure instance console log exists: /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 37f47320-be8b-4d7a-b8a2-228e4894f881 is timed out.
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Successfully created port: 9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:45:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully detached device vdb from instance 37f47320-be8b-4d7a-b8a2-228e4894f881 from the live domain config.
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AqKaDIuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87f0873-6457-403d-a2e5-0ba8dfe369e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:20 user nova-compute[75095]: No targets found.
Nov 15 15:45:20 user nova-compute[75095]: iSNS:
Nov 15 15:45:20 user nova-compute[75095]: No targets found.
Nov 15 15:45:20 user nova-compute[75095]: STATIC:
Nov 15 15:45:20 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b
Nov 15 15:45:20 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:20 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:20 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:20 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:20 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:20 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:45:20 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:20 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:20 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:45:20 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:20 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:20 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:20 user nova-compute[75095]: No targets found.
Nov 15 15:45:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:20 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:20 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e9c9fe-8b2b-4d96-b61b-c9fbba47bd13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b9a294-e372-4d7a-a9f7-f54a44a02ba7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:20 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3de170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b'): ({'sdf'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Removing single pathed devices sdf {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Stashing vm_state: active {{(pid=75095) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00bf09e-d789-4eb4-aba2-a61af3268619]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd498ea-918f-4d40-a447-de5f682d908d]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flushing IO for device /dev/sdf {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e2c39d-a413-43bd-a49b-537850b00d84]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[526fb725-da59-42df-b7f7-620f9e3634a0]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f94b45-e5e5-43ee-a04a-9522627c89ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:21 user nova-compute[75095]: INFO nova.compute.manager [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attaching volume 56b0e0ba-8778-4f95-9a6f-198308b4ba7d to /dev/vdc
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:45:21 user nova-compute[75095]: INFO nova.compute.claims [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Claim successful on node user
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa4ed4a-a7d9-4b6b-a0d2-33502c1fe29d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260]
Nov 15 15:45:21 user nova-compute[75095]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating resource usage from migration 01477937-a7af-40c0-b3c8-e73b62d22814
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a42a7806-6282-4f8c-9e61-23cc8628e26b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9cdbc-cdd5-4878-850d-8e77b21b380e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== disconnect_volume: return (347ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0351c93f-1dc1-444e-8e6e-30742e448f56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[937aa176-e186-496f-a1e6-fcc936086364]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6f9650-6491-40a5-99f1-2a6b7de81ee8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[74402a87-bbc1-4114-b383-0d7e6535e68c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:21 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729bde5-051e-42e2-b19a-4a5888e94d97]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating existing volume attachment record: 3320af99-cdf0-45d0-9e77-6f0e754c67dd {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Successfully updated port: 9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-changed-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Refreshing instance network info cache due to event network-changed-9c0013c1-69f5-4691-b337-c8f77c87838f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] Acquiring lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.472s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:21 user nova-compute[75095]: INFO nova.compute.manager [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Migrating
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:21 user nova-compute[75095]: INFO nova.compute.rpcapi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Instance network_info: |[{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] Acquired lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Refreshing network info cache for port 9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Start _get_guest_xml network_info=[{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:45:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2053381474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2053381474',id=13,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-n04nwudg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:20Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=8590b8bb-61ea-4e65-826e-c8e0caf4620e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 8590b8bb-61ea-4e65-826e-c8e0caf4620e {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:45:21 user nova-compute[75095]:   <uuid>8590b8bb-61ea-4e65-826e-c8e0caf4620e</uuid>
Nov 15 15:45:21 user nova-compute[75095]:   <name>instance-0000000d</name>
Nov 15 15:45:21 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:45:21 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:45:21 user nova-compute[75095]:   <metadata>
Nov 15 15:45:21 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:21 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2053381474</nova:name>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:45:21</nova:creationTime>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:45:21 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:21 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:owner>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:45:21 user nova-compute[75095]:       </nova:owner>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:21 user nova-compute[75095]:       <nova:ports>
Nov 15 15:45:21 user nova-compute[75095]:         <nova:port uuid="9c0013c1-69f5-4691-b337-c8f77c87838f">
Nov 15 15:45:21 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:21 user nova-compute[75095]:         </nova:port>
Nov 15 15:45:21 user nova-compute[75095]:       </nova:ports>
Nov 15 15:45:21 user nova-compute[75095]:     </nova:instance>
Nov 15 15:45:21 user nova-compute[75095]:   </metadata>
Nov 15 15:45:21 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:45:21 user nova-compute[75095]:     <system>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="serial">8590b8bb-61ea-4e65-826e-c8e0caf4620e</entry>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="uuid">8590b8bb-61ea-4e65-826e-c8e0caf4620e</entry>
Nov 15 15:45:21 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:45:21 user nova-compute[75095]:     </system>
Nov 15 15:45:21 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:21 user nova-compute[75095]:   <os>
Nov 15 15:45:21 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:45:21 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:45:21 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:45:21 user nova-compute[75095]:   </os>
Nov 15 15:45:21 user nova-compute[75095]:   <features>
Nov 15 15:45:21 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:21 user nova-compute[75095]:     <apic/>
Nov 15 15:45:21 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:45:21 user nova-compute[75095]:   </features>
Nov 15 15:45:21 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:45:21 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:45:21 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:45:21 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:45:21 user nova-compute[75095]:   </clock>
Nov 15 15:45:21 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:45:21 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:45:21 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:45:21 user nova-compute[75095]:   </cpu>
Nov 15 15:45:21 user nova-compute[75095]:   <devices>
Nov 15 15:45:21 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:45:21 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:45:21 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk"/>
Nov 15 15:45:21 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:45:21 user nova-compute[75095]:     </disk>
Nov 15 15:45:21 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:45:21 user nova-compute[75095]:       <mac address="fa:16:3e:5d:02:e9"/>
Nov 15 15:45:21 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:21 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:45:21 user nova-compute[75095]:       <target dev="tap9c0013c1-69"/>
Nov 15 15:45:21 user nova-compute[75095]:     </interface>
Nov 15 15:45:21 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:45:21 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/console.log" append="off"/>
Nov 15 15:45:21 user nova-compute[75095]:     </serial>
Nov 15 15:45:21 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:45:21 user nova-compute[75095]:     <video>
Nov 15 15:45:21 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:21 user nova-compute[75095]:     </video>
Nov 15 15:45:21 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:45:21 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:45:21 user nova-compute[75095]:     </rng>
Nov 15 15:45:21 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:45:21 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:45:21 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:45:21 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:21 user nova-compute[75095]:   </devices>
Nov 15 15:45:21 user nova-compute[75095]: </domain>
Nov 15 15:45:21 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2053381474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2053381474',id=13,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-n04nwudg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:20Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=8590b8bb-61ea-4e65-826e-c8e0caf4620e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG os_vif [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7633b68d-4e86-5459-8eb1-dcdef2f58592', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c0013c1-69, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c0013c1-69, col_values=(('qos', UUID('513b7b2f-9906-4074-a04c-c82a89757b1f')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c0013c1-69, col_values=(('external_ids', {'iface-id': '9c0013c1-69f5-4691-b337-c8f77c87838f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:02:e9', 'vm-uuid': '8590b8bb-61ea-4e65-826e-c8e0caf4620e'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:21 user nova-compute[75095]: INFO os_vif [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69')
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:5d:02:e9, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-173ef631-2f82-4798-92e6-ac398d29be51 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.811s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Starting migrate_disk_and_power_off {{(pid=75095) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updated VIF entry in instance network info cache for port 9c0013c1-69f5-4691-b337-c8f77c87838f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2a159ac8-3225-4fb5-b9c7-f8e369903c0e req-f08aa394-8f44-4518-b5de-96b8b202c2fe service nova] Releasing lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance destroyed successfully.
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb02c9c61-08, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:23 user nova-compute[75095]: WARNING nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state resize_migrating.
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:23 user nova-compute[75095]: WARNING nova.compute.manager [req-f2fae7ec-9490-4ea0-ae87-01ca457d4ed3 req-13e1ef61-9fd5-4372-8e2d-59905cc8eeba service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state resize_migrating.
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae0bdd5c-67c2-4b5d-8ef4-846f19505776) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:23 user nova-compute[75095]: INFO os_vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:23 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d761f706-af67-48dc-ad55-7fc82f300bdb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:23 user nova-compute[75095]: No targets found.
Nov 15 15:45:23 user nova-compute[75095]: iSNS:
Nov 15 15:45:23 user nova-compute[75095]: No targets found.
Nov 15 15:45:23 user nova-compute[75095]: STATIC:
Nov 15 15:45:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:45:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:45:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:23 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:23 user nova-compute[75095]: No targets found.
Nov 15 15:45:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:23 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:23 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdfa32e-a345-4017-8272-1c2fa0bcbf2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d26d3-6054-4919-8334-2ad040fcef9d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:23 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:23 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:23 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:23 user nova-compute[75095]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c466e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f30ace-14fc-43e9-ac13-e8b0a2c1d0c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e9bb5d-c6ed-4548-89fc-26250dfbec6c]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7fb743-a082-4692-9745-ca9ec4d66bcb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] No waiting events found dispatching network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:23 user nova-compute[75095]: WARNING nova.compute.manager [req-34e3a469-fa6a-4c12-8840-25156bcd8edd req-7330f0a4-4e93-4944-ab96-c2c0d0888ebf service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received unexpected event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f for instance with vm_state building and task_state spawning.
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff148d7b-afb1-44e8-8b8b-dd6fa571151b]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[681020b7-4b35-42a0-a58e-fa6a182a582f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1b63f-017c-4799-bbe0-3b85a3000e60]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:45:23 user nova-compute[75095]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa54f03b-0087-4afb-9543-eb619be1e18d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== disconnect_volume: return (341ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_resize/disk /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "cp -r /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_resize/disk /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk" returned: 0 in 0.382s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_resize/disk.info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk.info {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "cp -r /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_resize/disk.info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk.info" returned: 0 in 0.036s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Port b02c9c61-0809-40d0-be33-1d8b596c67b2 binding to destination host user is already ACTIVE {{(pid=75095) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] No waiting events found dispatching network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:25 user nova-compute[75095]: WARNING nova.compute.manager [req-f3352c72-b058-47f0-a379-a4e4621b75be req-0518feff-c45d-4613-92aa-b8c8741849f5 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received unexpected event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f for instance with vm_state building and task_state spawning.
Nov 15 15:45:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Instance spawned successfully.
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:25 user nova-compute[75095]: INFO nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:45:26 user nova-compute[75095]: INFO nova.compute.manager [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Took 6.99 seconds to build instance.
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463f27c6-1ada-4922-b430-9220c1f13a74 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvwLNmon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:26 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a637444d-6999-431a-bd7d-91ce5d53274e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:45:26 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f1363a-72da-47ef-bf99-6ff663b85399]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d] added
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb56f2f-89e8-4b60-b627-26b77e48f801]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06d17f-8541-450e-a786-0bb1aa5882ca]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvwLNmon {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KvwLNmon" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cb3e31-5f3d-47b5-a764-c5937f3a74fc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KvwLNmon'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e3461-547e-4641-a134-09e72857cf7b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b132a8f4-f4d2-42c0-b3c2-9bb46a09f35d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.utils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a6b8e3-8aa5-40b8-a525-4711e63e8288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c94ac6-0983-4a26-9a89-90ba37124e06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260]
Nov 15 15:45:26 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bd7736-ce0e-400c-a634-d3ec8d781c86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80253b4-3c70-41f1-acbc-b3011415e844]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb66956-9b5f-471f-bbb9-3060dec80dcc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa22e9b4-ff14-4c90-bb15-22271512714e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ad6642-7028-4a07-a06d-519f83df9363]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:26 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:45:26 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de6a5bd-e72d-4a4f-8762-6454fa2fc221]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.utils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7b1b52-ce76-4954-a6b2-0c11e60abdc4]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:45:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvwLNmon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:45:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Waiting for libvirt event about the detach of device tapb49e134b-01 with device alias net1 from instance 82cf5365-8116-43dc-adcf-58006b301b6b is timed out.
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 15:45:27 user nova-compute[75095]:   <name>instance-00000006</name>
Nov 15 15:45:27 user nova-compute[75095]:   <uuid>82cf5365-8116-43dc-adcf-58006b301b6b</uuid>
Nov 15 15:45:27 user nova-compute[75095]:   <metadata>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:27 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:44:35</nova:creationTime>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:27 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:27 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:27 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:port uuid="b49e134b-013a-4df1-92bf-fc794a88d5d6">
Nov 15 15:45:27 user nova-compute[75095]:       <nova:ip type="fixed" address="10.10.10.24" ipVersion="4"/>
Nov 15 15:45:27 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:27 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:27 user nova-compute[75095]:   </metadata>
Nov 15 15:45:27 user nova-compute[75095]:   <memory unit='KiB'>524288</memory>
Nov 15 15:45:27 user nova-compute[75095]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 15:45:27 user nova-compute[75095]:   <vcpu placement='static'>1</vcpu>
Nov 15 15:45:27 user nova-compute[75095]:   <resource>
Nov 15 15:45:27 user nova-compute[75095]:     <partition>/machine</partition>
Nov 15 15:45:27 user nova-compute[75095]:   </resource>
Nov 15 15:45:27 user nova-compute[75095]:   <sysinfo type='smbios'>
Nov 15 15:45:27 user nova-compute[75095]:     <system>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='version'>0.0.0</entry>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='serial'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='uuid'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:27 user nova-compute[75095]:       <entry name='family'>Virtual Machine</entry>
Nov 15 15:45:27 user nova-compute[75095]:     </system>
Nov 15 15:45:27 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:27 user nova-compute[75095]:   <os>
Nov 15 15:45:27 user nova-compute[75095]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 15:45:27 user nova-compute[75095]:     <boot dev='hd'/>
Nov 15 15:45:27 user nova-compute[75095]:     <smbios mode='sysinfo'/>
Nov 15 15:45:27 user nova-compute[75095]:   </os>
Nov 15 15:45:27 user nova-compute[75095]:   <features>
Nov 15 15:45:27 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:27 user nova-compute[75095]:     <apic/>
Nov 15 15:45:27 user nova-compute[75095]:     <vmcoreinfo state='on'/>
Nov 15 15:45:27 user nova-compute[75095]:   </features>
Nov 15 15:45:27 user nova-compute[75095]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 15:45:27 user nova-compute[75095]:     <model fallback='forbid'>Nehalem</model>
Nov 15 15:45:27 user nova-compute[75095]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 15:45:27 user nova-compute[75095]:     <feature policy='require' name='vme'/>
Nov 15 15:45:27 user nova-compute[75095]:     <feature policy='require' name='x2apic'/>
Nov 15 15:45:27 user nova-compute[75095]:     <feature policy='require' name='hypervisor'/>
Nov 15 15:45:27 user nova-compute[75095]:   </cpu>
Nov 15 15:45:27 user nova-compute[75095]:   <clock offset='utc'>
Nov 15 15:45:27 user nova-compute[75095]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 15:45:27 user nova-compute[75095]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 15:45:27 user nova-compute[75095]:     <timer name='hpet' present='no'/>
Nov 15 15:45:27 user nova-compute[75095]:   </clock>
Nov 15 15:45:27 user nova-compute[75095]:   <on_poweroff>destroy</on_poweroff>
Nov 15 15:45:27 user nova-compute[75095]:   <on_reboot>restart</on_reboot>
Nov 15 15:45:27 user nova-compute[75095]:   <on_crash>destroy</on_crash>
Nov 15 15:45:27 user nova-compute[75095]:   <devices>
Nov 15 15:45:27 user nova-compute[75095]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 15:45:27 user nova-compute[75095]:     <disk type='file' device='disk'>
Nov 15 15:45:27 user nova-compute[75095]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 15:45:27 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk' index='2'/>
Nov 15 15:45:27 user nova-compute[75095]:       <backingStore type='file' index='3'>
Nov 15 15:45:27 user nova-compute[75095]:         <format type='raw'/>
Nov 15 15:45:27 user nova-compute[75095]:         <source file='/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003'/>
Nov 15 15:45:27 user nova-compute[75095]:         <backingStore/>
Nov 15 15:45:27 user nova-compute[75095]:       </backingStore>
Nov 15 15:45:27 user nova-compute[75095]:       <target dev='vda' bus='virtio'/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='virtio-disk0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </disk>
Nov 15 15:45:27 user nova-compute[75095]:     <disk type='file' device='cdrom'>
Nov 15 15:45:27 user nova-compute[75095]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 15:45:27 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config' index='1'/>
Nov 15 15:45:27 user nova-compute[75095]:       <backingStore/>
Nov 15 15:45:27 user nova-compute[75095]:       <target dev='hda' bus='ide'/>
Nov 15 15:45:27 user nova-compute[75095]:       <readonly/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='ide0-0-0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </disk>
Nov 15 15:45:27 user nova-compute[75095]:     <controller type='usb' index='0' model='none'>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='usb'/>
Nov 15 15:45:27 user nova-compute[75095]:     </controller>
Nov 15 15:45:27 user nova-compute[75095]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='pci.0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </controller>
Nov 15 15:45:27 user nova-compute[75095]:     <controller type='ide' index='0'>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='ide'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 15:45:27 user nova-compute[75095]:     </controller>
Nov 15 15:45:27 user nova-compute[75095]:     <interface type='ethernet'>
Nov 15 15:45:27 user nova-compute[75095]:       <mac address='fa:16:3e:36:9f:cd'/>
Nov 15 15:45:27 user nova-compute[75095]:       <target dev='tap6114f792-10'/>
Nov 15 15:45:27 user nova-compute[75095]:       <model type='virtio'/>
Nov 15 15:45:27 user nova-compute[75095]:       <mtu size='1442'/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='net0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </interface>
Nov 15 15:45:27 user nova-compute[75095]:     <serial type='pty'>
Nov 15 15:45:27 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:27 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:27 user nova-compute[75095]:       <target type='isa-serial' port='0'>
Nov 15 15:45:27 user nova-compute[75095]:         <model name='isa-serial'/>
Nov 15 15:45:27 user nova-compute[75095]:       </target>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </serial>
Nov 15 15:45:27 user nova-compute[75095]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 15:45:27 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:27 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:27 user nova-compute[75095]:       <target type='serial' port='0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </console>
Nov 15 15:45:27 user nova-compute[75095]:     <input type='mouse' bus='ps2'>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='input0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </input>
Nov 15 15:45:27 user nova-compute[75095]:     <input type='keyboard' bus='ps2'>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='input1'/>
Nov 15 15:45:27 user nova-compute[75095]:     </input>
Nov 15 15:45:27 user nova-compute[75095]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 15:45:27 user nova-compute[75095]:       <listen type='address' address='0.0.0.0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </graphics>
Nov 15 15:45:27 user nova-compute[75095]:     <audio id='1' type='none'/>
Nov 15 15:45:27 user nova-compute[75095]:     <video>
Nov 15 15:45:27 user nova-compute[75095]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='video0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </video>
Nov 15 15:45:27 user nova-compute[75095]:     <memballoon model='virtio'>
Nov 15 15:45:27 user nova-compute[75095]:       <stats period='10'/>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='balloon0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:27 user nova-compute[75095]:     <rng model='virtio'>
Nov 15 15:45:27 user nova-compute[75095]:       <backend model='random'>/dev/urandom</backend>
Nov 15 15:45:27 user nova-compute[75095]:       <alias name='rng0'/>
Nov 15 15:45:27 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 15:45:27 user nova-compute[75095]:     </rng>
Nov 15 15:45:27 user nova-compute[75095]:   </devices>
Nov 15 15:45:27 user nova-compute[75095]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 15:45:27 user nova-compute[75095]:     <label>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</label>
Nov 15 15:45:27 user nova-compute[75095]:     <imagelabel>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</imagelabel>
Nov 15 15:45:27 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:27 user nova-compute[75095]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 15:45:27 user nova-compute[75095]:     <label>+64055:+108</label>
Nov 15 15:45:27 user nova-compute[75095]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 15:45:27 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:27 user nova-compute[75095]: </domain>
Nov 15 15:45:27 user nova-compute[75095]:  {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 15:45:27 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully detached device tapb49e134b-01 from instance 82cf5365-8116-43dc-adcf-58006b301b6b from the live domain config.
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG os_vif [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb49e134b-01, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6faed2f8-a735-4138-a0bd-bda6d8ee9c26) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:27 user nova-compute[75095]: INFO os_vif [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01')
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:27 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:45:27</nova:creationTime>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:27 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:27 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:27 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:27 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:27 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:27 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:27 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:27 user nova-compute[75095]:  {{(pid=75095) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26331633736653738', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331633736653738', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:45:27 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:27 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:45:27 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 15:45:27 user nova-compute[75095]:   <serial>56b0e0ba-8778-4f95-9a6f-198308b4ba7d</serial>
Nov 15 15:45:27 user nova-compute[75095]: </disk>
Nov 15 15:45:27 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] No VIF found with MAC fa:16:3e:84:38:51, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e020a42-d646-4c3a-a20f-6e57624518b0 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.157s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-deleted-b49e134b-013a-4df1-92bf-fc794a88d5d6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:28 user nova-compute[75095]: INFO nova.compute.manager [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Neutron deleted interface b49e134b-013a-4df1-92bf-fc794a88d5d6; detaching it from the instance and deleting it from the info cache
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.neutron [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquired lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.objects.instance [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Lazy-loading 'system_metadata' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.objects.instance [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Lazy-loading 'flavor' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.objects.base [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Object Instance<82cf5365-8116-43dc-adcf-58006b301b6b> lazy-loaded attributes: system_metadata,flavor {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 15:45:28 user nova-compute[75095]:   <name>instance-00000006</name>
Nov 15 15:45:28 user nova-compute[75095]:   <uuid>82cf5365-8116-43dc-adcf-58006b301b6b</uuid>
Nov 15 15:45:28 user nova-compute[75095]:   <metadata>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:28 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:45:27</nova:creationTime>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:28 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:28 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:28 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:28 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:28 user nova-compute[75095]:   </metadata>
Nov 15 15:45:28 user nova-compute[75095]:   <memory unit='KiB'>524288</memory>
Nov 15 15:45:28 user nova-compute[75095]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 15:45:28 user nova-compute[75095]:   <vcpu placement='static'>1</vcpu>
Nov 15 15:45:28 user nova-compute[75095]:   <resource>
Nov 15 15:45:28 user nova-compute[75095]:     <partition>/machine</partition>
Nov 15 15:45:28 user nova-compute[75095]:   </resource>
Nov 15 15:45:28 user nova-compute[75095]:   <sysinfo type='smbios'>
Nov 15 15:45:28 user nova-compute[75095]:     <system>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='version'>0.0.0</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='serial'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='uuid'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='family'>Virtual Machine</entry>
Nov 15 15:45:28 user nova-compute[75095]:     </system>
Nov 15 15:45:28 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:28 user nova-compute[75095]:   <os>
Nov 15 15:45:28 user nova-compute[75095]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 15:45:28 user nova-compute[75095]:     <boot dev='hd'/>
Nov 15 15:45:28 user nova-compute[75095]:     <smbios mode='sysinfo'/>
Nov 15 15:45:28 user nova-compute[75095]:   </os>
Nov 15 15:45:28 user nova-compute[75095]:   <features>
Nov 15 15:45:28 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:28 user nova-compute[75095]:     <apic/>
Nov 15 15:45:28 user nova-compute[75095]:     <vmcoreinfo state='on'/>
Nov 15 15:45:28 user nova-compute[75095]:   </features>
Nov 15 15:45:28 user nova-compute[75095]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 15:45:28 user nova-compute[75095]:     <model fallback='forbid'>Nehalem</model>
Nov 15 15:45:28 user nova-compute[75095]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='vme'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='x2apic'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='hypervisor'/>
Nov 15 15:45:28 user nova-compute[75095]:   </cpu>
Nov 15 15:45:28 user nova-compute[75095]:   <clock offset='utc'>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='hpet' present='no'/>
Nov 15 15:45:28 user nova-compute[75095]:   </clock>
Nov 15 15:45:28 user nova-compute[75095]:   <on_poweroff>destroy</on_poweroff>
Nov 15 15:45:28 user nova-compute[75095]:   <on_reboot>restart</on_reboot>
Nov 15 15:45:28 user nova-compute[75095]:   <on_crash>destroy</on_crash>
Nov 15 15:45:28 user nova-compute[75095]:   <devices>
Nov 15 15:45:28 user nova-compute[75095]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 15:45:28 user nova-compute[75095]:     <disk type='file' device='disk'>
Nov 15 15:45:28 user nova-compute[75095]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 15:45:28 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk' index='2'/>
Nov 15 15:45:28 user nova-compute[75095]:       <backingStore type='file' index='3'>
Nov 15 15:45:28 user nova-compute[75095]:         <format type='raw'/>
Nov 15 15:45:28 user nova-compute[75095]:         <source file='/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003'/>
Nov 15 15:45:28 user nova-compute[75095]:         <backingStore/>
Nov 15 15:45:28 user nova-compute[75095]:       </backingStore>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='vda' bus='virtio'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='virtio-disk0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </disk>
Nov 15 15:45:28 user nova-compute[75095]:     <disk type='file' device='cdrom'>
Nov 15 15:45:28 user nova-compute[75095]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 15:45:28 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config' index='1'/>
Nov 15 15:45:28 user nova-compute[75095]:       <backingStore/>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='hda' bus='ide'/>
Nov 15 15:45:28 user nova-compute[75095]:       <readonly/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='ide0-0-0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </disk>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='usb' index='0' model='none'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='usb'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='pci.0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='ide' index='0'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='ide'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <interface type='ethernet'>
Nov 15 15:45:28 user nova-compute[75095]:       <mac address='fa:16:3e:36:9f:cd'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='tap6114f792-10'/>
Nov 15 15:45:28 user nova-compute[75095]:       <model type='virtio'/>
Nov 15 15:45:28 user nova-compute[75095]:       <mtu size='1442'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='net0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </interface>
Nov 15 15:45:28 user nova-compute[75095]:     <serial type='pty'>
Nov 15 15:45:28 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:28 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target type='isa-serial' port='0'>
Nov 15 15:45:28 user nova-compute[75095]:         <model name='isa-serial'/>
Nov 15 15:45:28 user nova-compute[75095]:       </target>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </serial>
Nov 15 15:45:28 user nova-compute[75095]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 15:45:28 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:28 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target type='serial' port='0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </console>
Nov 15 15:45:28 user nova-compute[75095]:     <input type='mouse' bus='ps2'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='input0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </input>
Nov 15 15:45:28 user nova-compute[75095]:     <input type='keyboard' bus='ps2'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='input1'/>
Nov 15 15:45:28 user nova-compute[75095]:     </input>
Nov 15 15:45:28 user nova-compute[75095]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 15:45:28 user nova-compute[75095]:       <listen type='address' address='0.0.0.0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </graphics>
Nov 15 15:45:28 user nova-compute[75095]:     <audio id='1' type='none'/>
Nov 15 15:45:28 user nova-compute[75095]:     <video>
Nov 15 15:45:28 user nova-compute[75095]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='video0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </video>
Nov 15 15:45:28 user nova-compute[75095]:     <memballoon model='virtio'>
Nov 15 15:45:28 user nova-compute[75095]:       <stats period='10'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='balloon0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:28 user nova-compute[75095]:     <rng model='virtio'>
Nov 15 15:45:28 user nova-compute[75095]:       <backend model='random'>/dev/urandom</backend>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='rng0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </rng>
Nov 15 15:45:28 user nova-compute[75095]:   </devices>
Nov 15 15:45:28 user nova-compute[75095]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 15:45:28 user nova-compute[75095]:     <label>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</label>
Nov 15 15:45:28 user nova-compute[75095]:     <imagelabel>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</imagelabel>
Nov 15 15:45:28 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:28 user nova-compute[75095]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 15:45:28 user nova-compute[75095]:     <label>+64055:+108</label>
Nov 15 15:45:28 user nova-compute[75095]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 15:45:28 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:28 user nova-compute[75095]: </domain>
Nov 15 15:45:28 user nova-compute[75095]:  {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface> {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:f8:bd"/><model type="virtio"/><mtu size="1442"/><target dev="tapb49e134b-01"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 15 15:45:28 user nova-compute[75095]:   <name>instance-00000006</name>
Nov 15 15:45:28 user nova-compute[75095]:   <uuid>82cf5365-8116-43dc-adcf-58006b301b6b</uuid>
Nov 15 15:45:28 user nova-compute[75095]:   <metadata>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:28 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:45:27</nova:creationTime>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:28 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:28 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:28 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:28 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:28 user nova-compute[75095]:   </metadata>
Nov 15 15:45:28 user nova-compute[75095]:   <memory unit='KiB'>524288</memory>
Nov 15 15:45:28 user nova-compute[75095]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 15:45:28 user nova-compute[75095]:   <vcpu placement='static'>1</vcpu>
Nov 15 15:45:28 user nova-compute[75095]:   <resource>
Nov 15 15:45:28 user nova-compute[75095]:     <partition>/machine</partition>
Nov 15 15:45:28 user nova-compute[75095]:   </resource>
Nov 15 15:45:28 user nova-compute[75095]:   <sysinfo type='smbios'>
Nov 15 15:45:28 user nova-compute[75095]:     <system>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='version'>0.0.0</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='serial'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='uuid'>82cf5365-8116-43dc-adcf-58006b301b6b</entry>
Nov 15 15:45:28 user nova-compute[75095]:       <entry name='family'>Virtual Machine</entry>
Nov 15 15:45:28 user nova-compute[75095]:     </system>
Nov 15 15:45:28 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:28 user nova-compute[75095]:   <os>
Nov 15 15:45:28 user nova-compute[75095]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 15:45:28 user nova-compute[75095]:     <boot dev='hd'/>
Nov 15 15:45:28 user nova-compute[75095]:     <smbios mode='sysinfo'/>
Nov 15 15:45:28 user nova-compute[75095]:   </os>
Nov 15 15:45:28 user nova-compute[75095]:   <features>
Nov 15 15:45:28 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:28 user nova-compute[75095]:     <apic/>
Nov 15 15:45:28 user nova-compute[75095]:     <vmcoreinfo state='on'/>
Nov 15 15:45:28 user nova-compute[75095]:   </features>
Nov 15 15:45:28 user nova-compute[75095]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 15:45:28 user nova-compute[75095]:     <model fallback='forbid'>Nehalem</model>
Nov 15 15:45:28 user nova-compute[75095]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='vme'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='x2apic'/>
Nov 15 15:45:28 user nova-compute[75095]:     <feature policy='require' name='hypervisor'/>
Nov 15 15:45:28 user nova-compute[75095]:   </cpu>
Nov 15 15:45:28 user nova-compute[75095]:   <clock offset='utc'>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 15:45:28 user nova-compute[75095]:     <timer name='hpet' present='no'/>
Nov 15 15:45:28 user nova-compute[75095]:   </clock>
Nov 15 15:45:28 user nova-compute[75095]:   <on_poweroff>destroy</on_poweroff>
Nov 15 15:45:28 user nova-compute[75095]:   <on_reboot>restart</on_reboot>
Nov 15 15:45:28 user nova-compute[75095]:   <on_crash>destroy</on_crash>
Nov 15 15:45:28 user nova-compute[75095]:   <devices>
Nov 15 15:45:28 user nova-compute[75095]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 15:45:28 user nova-compute[75095]:     <disk type='file' device='disk'>
Nov 15 15:45:28 user nova-compute[75095]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 15:45:28 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk' index='2'/>
Nov 15 15:45:28 user nova-compute[75095]:       <backingStore type='file' index='3'>
Nov 15 15:45:28 user nova-compute[75095]:         <format type='raw'/>
Nov 15 15:45:28 user nova-compute[75095]:         <source file='/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003'/>
Nov 15 15:45:28 user nova-compute[75095]:         <backingStore/>
Nov 15 15:45:28 user nova-compute[75095]:       </backingStore>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='vda' bus='virtio'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='virtio-disk0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </disk>
Nov 15 15:45:28 user nova-compute[75095]:     <disk type='file' device='cdrom'>
Nov 15 15:45:28 user nova-compute[75095]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 15:45:28 user nova-compute[75095]:       <source file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/disk.config' index='1'/>
Nov 15 15:45:28 user nova-compute[75095]:       <backingStore/>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='hda' bus='ide'/>
Nov 15 15:45:28 user nova-compute[75095]:       <readonly/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='ide0-0-0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </disk>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='usb' index='0' model='none'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='usb'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='pci.0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <controller type='ide' index='0'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='ide'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 15:45:28 user nova-compute[75095]:     </controller>
Nov 15 15:45:28 user nova-compute[75095]:     <interface type='ethernet'>
Nov 15 15:45:28 user nova-compute[75095]:       <mac address='fa:16:3e:36:9f:cd'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target dev='tap6114f792-10'/>
Nov 15 15:45:28 user nova-compute[75095]:       <model type='virtio'/>
Nov 15 15:45:28 user nova-compute[75095]:       <mtu size='1442'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='net0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </interface>
Nov 15 15:45:28 user nova-compute[75095]:     <serial type='pty'>
Nov 15 15:45:28 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:28 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target type='isa-serial' port='0'>
Nov 15 15:45:28 user nova-compute[75095]:         <model name='isa-serial'/>
Nov 15 15:45:28 user nova-compute[75095]:       </target>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </serial>
Nov 15 15:45:28 user nova-compute[75095]:     <console type='pty' tty='/dev/pts/5'>
Nov 15 15:45:28 user nova-compute[75095]:       <source path='/dev/pts/5'/>
Nov 15 15:45:28 user nova-compute[75095]:       <log file='/opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b/console.log' append='off'/>
Nov 15 15:45:28 user nova-compute[75095]:       <target type='serial' port='0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='serial0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </console>
Nov 15 15:45:28 user nova-compute[75095]:     <input type='mouse' bus='ps2'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='input0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </input>
Nov 15 15:45:28 user nova-compute[75095]:     <input type='keyboard' bus='ps2'>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='input1'/>
Nov 15 15:45:28 user nova-compute[75095]:     </input>
Nov 15 15:45:28 user nova-compute[75095]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 15 15:45:28 user nova-compute[75095]:       <listen type='address' address='0.0.0.0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </graphics>
Nov 15 15:45:28 user nova-compute[75095]:     <audio id='1' type='none'/>
Nov 15 15:45:28 user nova-compute[75095]:     <video>
Nov 15 15:45:28 user nova-compute[75095]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='video0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </video>
Nov 15 15:45:28 user nova-compute[75095]:     <memballoon model='virtio'>
Nov 15 15:45:28 user nova-compute[75095]:       <stats period='10'/>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='balloon0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:28 user nova-compute[75095]:     <rng model='virtio'>
Nov 15 15:45:28 user nova-compute[75095]:       <backend model='random'>/dev/urandom</backend>
Nov 15 15:45:28 user nova-compute[75095]:       <alias name='rng0'/>
Nov 15 15:45:28 user nova-compute[75095]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 15:45:28 user nova-compute[75095]:     </rng>
Nov 15 15:45:28 user nova-compute[75095]:   </devices>
Nov 15 15:45:28 user nova-compute[75095]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 15:45:28 user nova-compute[75095]:     <label>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</label>
Nov 15 15:45:28 user nova-compute[75095]:     <imagelabel>libvirt-82cf5365-8116-43dc-adcf-58006b301b6b</imagelabel>
Nov 15 15:45:28 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:28 user nova-compute[75095]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 15:45:28 user nova-compute[75095]:     <label>+64055:+108</label>
Nov 15 15:45:28 user nova-compute[75095]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 15:45:28 user nova-compute[75095]:   </seclabel>
Nov 15 15:45:28 user nova-compute[75095]: </domain>
Nov 15 15:45:28 user nova-compute[75095]:  {{(pid=75095) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 15:45:28 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Detaching interface fa:16:3e:8b:f8:bd failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb49e134b-01' not found.
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Converting VIF {"id": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "address": "fa:16:3e:8b:f8:bd", "network": {"id": "10a6cdbb-4ca2-481f-96b8-8db03fa4e352", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-719823245", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb49e134b-01", "ovs_interfaceid": "b49e134b-013a-4df1-92bf-fc794a88d5d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG os_vif [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb49e134b-01, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:45:28 user nova-compute[75095]: INFO os_vif [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:f8:bd,bridge_name='br-int',has_traffic_filtering=True,id=b49e134b-013a-4df1-92bf-fc794a88d5d6,network=Network(10a6cdbb-4ca2-481f-96b8-8db03fa4e352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb49e134b-01')
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [req-ac24338f-55c9-4d0e-ab9d-7790007721b1 req-22c15073-a900-45cd-b812-d9e015fc8393 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:28 user nova-compute[75095]:   <nova:package version="0.0.0"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:name>tempest-device-tagging-server-1241390109</nova:name>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:creationTime>2023-11-15 15:45:28</nova:creationTime>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:flavor name="m1.tiny">
Nov 15 15:45:28 user nova-compute[75095]:     <nova:memory>512</nova:memory>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:disk>1</nova:disk>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:swap>0</nova:swap>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:flavor>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:user uuid="ffb7f652d1ea433a92ffcccf0b93f3b2">tempest-TaggedAttachmentsTest-635424622-project-member</nova:user>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:project uuid="7cb8bb4f0ef14c929f8ba8c60295b2ea">tempest-TaggedAttachmentsTest-635424622</nova:project>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:owner>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:28 user nova-compute[75095]:   <nova:ports>
Nov 15 15:45:28 user nova-compute[75095]:     <nova:port uuid="6114f792-1084-4110-a522-3e22b0991f20">
Nov 15 15:45:28 user nova-compute[75095]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:45:28 user nova-compute[75095]:     </nova:port>
Nov 15 15:45:28 user nova-compute[75095]:   </nova:ports>
Nov 15 15:45:28 user nova-compute[75095]: </nova:instance>
Nov 15 15:45:28 user nova-compute[75095]:  {{(pid=75095) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [{"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Releasing lock "refresh_cache-82cf5365-8116-43dc-adcf-58006b301b6b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2604c3df-b970-4cb8-80b7-35d2e0fe2ecd tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "interface-82cf5365-8116-43dc-adcf-58006b301b6b-b49e134b-013a-4df1-92bf-fc794a88d5d6" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.894s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:29 user nova-compute[75095]: INFO nova.compute.manager [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Detaching volume 56b0e0ba-8778-4f95-9a6f-198308b4ba7d
Nov 15 15:45:29 user nova-compute[75095]: INFO nova.virt.block_device [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attempting to driver detach volume 56b0e0ba-8778-4f95-9a6f-198308b4ba7d from mountpoint /dev/vdc
Nov 15 15:45:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Attempting to detach device vdc from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:45:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:45:29 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:29 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:45:29 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 15:45:29 user nova-compute[75095]:   <serial>56b0e0ba-8778-4f95-9a6f-198308b4ba7d</serial>
Nov 15 15:45:29 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 15:45:29 user nova-compute[75095]: </disk>
Nov 15 15:45:29 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:29 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully detached device vdc from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the persistent domain config.
Nov 15 15:45:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:45:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:45:29 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:29 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:45:29 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 15:45:29 user nova-compute[75095]:   <serial>56b0e0ba-8778-4f95-9a6f-198308b4ba7d</serial>
Nov 15 15:45:29 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 15:45:29 user nova-compute[75095]: </disk>
Nov 15 15:45:29 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:45:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Starting finish_migration {{(pid=75095) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:45:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Creating image(s)
Nov 15 15:45:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk. size=21474836480 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk 21474836480 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk 21474836480" returned: 0 in 0.306s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Ensure instance console log exists: /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start _get_guest_xml network_info=[{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '39ad9633-c571-4e79-bb6d-9428cfa04ae1', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7447d0b9-3152-49ab-8576-994810c20e29', 'attached_at': '2023-11-15T15:45:31.000000', 'detached_at': '', 'volume_id': 'fa151bd9-2d9d-4dc2-b38a-86c933895386', 'serial': 'fa151bd9-2d9d-4dc2-b38a-86c933895386'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:45:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:32 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:32 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:32 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf7c760-f5bb-4997-8d2b-afce46455f4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:45:32 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd9bff0-28f4-4976-a28c-7f69c654b5bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf28c7-d48e-4602-8b8d-7cc0c6b2ea79]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256dfd2-582f-4204-82f6-dde2a2be3c93]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846d975-fffa-4438-95cf-19d8c7fd5db0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byrQvwYn'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1520b6ed-b3b6-4f48-9a50-abad60633f5a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a982a5c8-c015-489a-a56c-06e096619d2b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a527b8-f2c3-4a6f-bc95-118a76cfc2ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:45:32 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39f11e-c61b-4a8b-8fe5-a27bb424d8ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1492c91f-847c-4373-ac58-268aad9622a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:32 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e13765-6117-40e8-afbf-f95aa1bde639]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:45:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:45:33 user nova-compute[75095]:   <uuid>7447d0b9-3152-49ab-8576-994810c20e29</uuid>
Nov 15 15:45:33 user nova-compute[75095]:   <name>instance-00000002</name>
Nov 15 15:45:33 user nova-compute[75095]:   <memory>2097152</memory>
Nov 15 15:45:33 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:45:33 user nova-compute[75095]:   <metadata>
Nov 15 15:45:33 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:33 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherB-server-67125786</nova:name>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:45:32</nova:creationTime>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:flavor name="m1.small">
Nov 15 15:45:33 user nova-compute[75095]:         <nova:memory>2048</nova:memory>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:disk>20</nova:disk>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:33 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:owner>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:user uuid="3f344bdd39e54736a7b7c7388bb8dbdb">tempest-ServerActionsTestOtherB-1639554019-project-member</nova:user>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:project uuid="2038e0b00a9d431eaadfaac074eaee2d">tempest-ServerActionsTestOtherB-1639554019</nova:project>
Nov 15 15:45:33 user nova-compute[75095]:       </nova:owner>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:33 user nova-compute[75095]:       <nova:ports>
Nov 15 15:45:33 user nova-compute[75095]:         <nova:port uuid="b02c9c61-0809-40d0-be33-1d8b596c67b2">
Nov 15 15:45:33 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:45:33 user nova-compute[75095]:         </nova:port>
Nov 15 15:45:33 user nova-compute[75095]:       </nova:ports>
Nov 15 15:45:33 user nova-compute[75095]:     </nova:instance>
Nov 15 15:45:33 user nova-compute[75095]:   </metadata>
Nov 15 15:45:33 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:45:33 user nova-compute[75095]:     <system>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="serial">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="uuid">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:45:33 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:45:33 user nova-compute[75095]:     </system>
Nov 15 15:45:33 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:33 user nova-compute[75095]:   <os>
Nov 15 15:45:33 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:45:33 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:45:33 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:45:33 user nova-compute[75095]:   </os>
Nov 15 15:45:33 user nova-compute[75095]:   <features>
Nov 15 15:45:33 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:33 user nova-compute[75095]:     <apic/>
Nov 15 15:45:33 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:45:33 user nova-compute[75095]:   </features>
Nov 15 15:45:33 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:45:33 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:45:33 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:45:33 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:45:33 user nova-compute[75095]:   </clock>
Nov 15 15:45:33 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:45:33 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:45:33 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:45:33 user nova-compute[75095]:   </cpu>
Nov 15 15:45:33 user nova-compute[75095]:   <devices>
Nov 15 15:45:33 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:45:33 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:45:33 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk"/>
Nov 15 15:45:33 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:45:33 user nova-compute[75095]:     </disk>
Nov 15 15:45:33 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:45:33 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:45:33 user nova-compute[75095]:       <source dev="/dev/sdd"/>
Nov 15 15:45:33 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:45:33 user nova-compute[75095]:       <serial>fa151bd9-2d9d-4dc2-b38a-86c933895386</serial>
Nov 15 15:45:33 user nova-compute[75095]:     </disk>
Nov 15 15:45:33 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:45:33 user nova-compute[75095]:       <mac address="fa:16:3e:56:ec:23"/>
Nov 15 15:45:33 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:33 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:45:33 user nova-compute[75095]:       <target dev="tapb02c9c61-08"/>
Nov 15 15:45:33 user nova-compute[75095]:     </interface>
Nov 15 15:45:33 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:45:33 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/console.log" append="off"/>
Nov 15 15:45:33 user nova-compute[75095]:     </serial>
Nov 15 15:45:33 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:45:33 user nova-compute[75095]:     <video>
Nov 15 15:45:33 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:33 user nova-compute[75095]:     </video>
Nov 15 15:45:33 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:45:33 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:45:33 user nova-compute[75095]:     </rng>
Nov 15 15:45:33 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:45:33 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:45:33 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:45:33 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:33 user nova-compute[75095]:   </devices>
Nov 15 15:45:33 user nova-compute[75095]: </domain>
Nov 15 15:45:33 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1581805547-network", "vif_mac": "fa:16:3e:56:ec:23"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG os_vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12b4c361-3a4f-5a90-9f69-e06add412966', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb02c9c61-08, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb02c9c61-08, col_values=(('qos', UUID('f82c6b03-bf10-4047-a1b0-767009bcf2d4')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb02c9c61-08, col_values=(('external_ids', {'iface-id': 'b02c9c61-0809-40d0-be33-1d8b596c67b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ec:23', 'vm-uuid': '7447d0b9-3152-49ab-8576-994810c20e29'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:33 user nova-compute[75095]: INFO os_vif [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] No VIF found with MAC fa:16:3e:56:ec:23, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:35 user nova-compute[75095]: WARNING nova.compute.manager [req-abb272aa-0f6a-4f44-9535-26f4c36b8d0c req-3275142a-b552-4179-ab50-fb931151d0c3 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state resize_finish.
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:45:36 user nova-compute[75095]: INFO nova.compute.claims [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Claim successful on node user
Nov 15 15:45:36 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:45:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.policy [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6594c4639944887bb9f9f3b9e6f4f67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fcf1dcb392a4ec2b16fb1eb42cf3185', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:45:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Creating image(s)
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "/opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "/opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:37 user nova-compute[75095]: WARNING nova.compute.manager [req-57ceafaa-edf6-4309-a76b-59422825fb33 req-1c73556e-99f5-43e3-86b2-74450eee934a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state resize_finish.
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:45:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance running successfully.
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Failed to set time: agent not configured {{(pid=75095) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-a29f9de1-2228-426f-a9fd-010bf3b26479 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] finish_migration finished successfully. {{(pid=75095) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Successfully created port: a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk 1073741824" returned: 0 in 0.056s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:45:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Cannot resize image /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Ensure instance console log exists: /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Successfully updated port: a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquired lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:38 user nova-compute[75095]: INFO nova.compute.manager [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Terminating instance
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Updating instance_info_cache with network_info: [{"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Releasing lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Instance network_info: |[{"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Start _get_guest_xml network_info=[{"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:45:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-85380442',display_name='tempest-VolumesActionsTest-instance-85380442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-85380442',id=14,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-v0uvor9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:37Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=9c39762d-35f9-45ef-bbb3-c00bd4adce91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c39762d-35f9-45ef-bbb3-c00bd4adce91 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-unplugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] No waiting events found dispatching network-vif-unplugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-fae636ee-7139-466d-b9dc-cb1eb1cadaf5 req-d3f8f0b7-9907-4425-ad16-89639638c311 service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-unplugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:45:38 user nova-compute[75095]:   <uuid>9c39762d-35f9-45ef-bbb3-c00bd4adce91</uuid>
Nov 15 15:45:38 user nova-compute[75095]:   <name>instance-0000000e</name>
Nov 15 15:45:38 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:45:38 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:45:38 user nova-compute[75095]:   <metadata>
Nov 15 15:45:38 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:45:38 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:name>tempest-VolumesActionsTest-instance-85380442</nova:name>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:45:38</nova:creationTime>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:45:38 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:45:38 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:owner>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:user uuid="c6594c4639944887bb9f9f3b9e6f4f67">tempest-VolumesActionsTest-962818578-project-member</nova:user>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:project uuid="5fcf1dcb392a4ec2b16fb1eb42cf3185">tempest-VolumesActionsTest-962818578</nova:project>
Nov 15 15:45:38 user nova-compute[75095]:       </nova:owner>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:45:38 user nova-compute[75095]:       <nova:ports>
Nov 15 15:45:38 user nova-compute[75095]:         <nova:port uuid="a041c0dd-ffb7-4dab-abb1-725b74c1892f">
Nov 15 15:45:38 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 15:45:38 user nova-compute[75095]:         </nova:port>
Nov 15 15:45:38 user nova-compute[75095]:       </nova:ports>
Nov 15 15:45:38 user nova-compute[75095]:     </nova:instance>
Nov 15 15:45:38 user nova-compute[75095]:   </metadata>
Nov 15 15:45:38 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:45:38 user nova-compute[75095]:     <system>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="serial">9c39762d-35f9-45ef-bbb3-c00bd4adce91</entry>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="uuid">9c39762d-35f9-45ef-bbb3-c00bd4adce91</entry>
Nov 15 15:45:38 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:45:38 user nova-compute[75095]:     </system>
Nov 15 15:45:38 user nova-compute[75095]:   </sysinfo>
Nov 15 15:45:38 user nova-compute[75095]:   <os>
Nov 15 15:45:38 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:45:38 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:45:38 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:45:38 user nova-compute[75095]:   </os>
Nov 15 15:45:38 user nova-compute[75095]:   <features>
Nov 15 15:45:38 user nova-compute[75095]:     <acpi/>
Nov 15 15:45:38 user nova-compute[75095]:     <apic/>
Nov 15 15:45:38 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:45:38 user nova-compute[75095]:   </features>
Nov 15 15:45:38 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:45:38 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:45:38 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:45:38 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:45:38 user nova-compute[75095]:   </clock>
Nov 15 15:45:38 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:45:38 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:45:38 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:45:38 user nova-compute[75095]:   </cpu>
Nov 15 15:45:38 user nova-compute[75095]:   <devices>
Nov 15 15:45:38 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:45:38 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:45:38 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk"/>
Nov 15 15:45:38 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:45:38 user nova-compute[75095]:     </disk>
Nov 15 15:45:38 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:45:38 user nova-compute[75095]:       <mac address="fa:16:3e:fc:7c:ff"/>
Nov 15 15:45:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:38 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:45:38 user nova-compute[75095]:       <target dev="tapa041c0dd-ff"/>
Nov 15 15:45:38 user nova-compute[75095]:     </interface>
Nov 15 15:45:38 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:45:38 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/console.log" append="off"/>
Nov 15 15:45:38 user nova-compute[75095]:     </serial>
Nov 15 15:45:38 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:45:38 user nova-compute[75095]:     <video>
Nov 15 15:45:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:45:38 user nova-compute[75095]:     </video>
Nov 15 15:45:38 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:45:38 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:45:38 user nova-compute[75095]:     </rng>
Nov 15 15:45:38 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:45:38 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:45:38 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:45:38 user nova-compute[75095]:     </memballoon>
Nov 15 15:45:38 user nova-compute[75095]:   </devices>
Nov 15 15:45:38 user nova-compute[75095]: </domain>
Nov 15 15:45:38 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-85380442',display_name='tempest-VolumesActionsTest-instance-85380442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-85380442',id=14,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-v0uvor9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:45:37Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=9c39762d-35f9-45ef-bbb3-c00bd4adce91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG os_vif [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b96de62f-88a0-5859-9a30-b5be2aa087c6', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa041c0dd-ff, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa041c0dd-ff, col_values=(('qos', UUID('1a27fa65-1e1a-4f62-9d54-03cb199436d5')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa041c0dd-ff, col_values=(('external_ids', {'iface-id': 'a041c0dd-ffb7-4dab-abb1-725b74c1892f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:7c:ff', 'vm-uuid': '9c39762d-35f9-45ef-bbb3-c00bd4adce91'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:38 user nova-compute[75095]: INFO os_vif [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff')
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:45:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] No VIF found with MAC fa:16:3e:fc:7c:ff, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-changed-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Refreshing instance network info cache due to event network-changed-a041c0dd-ffb7-4dab-abb1-725b74c1892f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] Acquiring lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] Acquired lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.neutron [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Refreshing network info cache for port a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:45:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Instance destroyed successfully.
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lazy-loading 'resources' on Instance uuid 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1687654312',display_name='tempest-VolumesAssistedSnapshotsTest-server-1687654312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1687654312',id=7,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVIRvVgpCl6gpCUVYraECE9F2twh75iAaqKTUOaYSUrRkWQKf2WL4poV2Nn05B04237hvU5sVBPZjrK9g6G9G0jVb5yqSAEJKDMl+dDhanqXU9poBazEuQ9u3XxFpTTgg==',key_name='tempest-keypair-1285756563',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0125799450d4db5804d3c14dac0f383',ramdisk_id='',reservation_id='r-5savtzs0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1507634686',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1507634686-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d535b1490c7149748f5e1e8abe972363',uuid=222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converting VIF {"id": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "address": "fa:16:3e:57:b3:e4", "network": {"id": "7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-965574352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0125799450d4db5804d3c14dac0f383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd045b7e2-05", "ovs_interfaceid": "d045b7e2-05f1-4c3f-9492-b1a6a7945dc9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG os_vif [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd045b7e2-05, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04e1b85b-8cf3-4c41-9808-296e77c2ec67) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:39 user nova-compute[75095]: INFO os_vif [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:b3:e4,bridge_name='br-int',has_traffic_filtering=True,id=d045b7e2-05f1-4c3f-9492-b1a6a7945dc9,network=Network(7eb2ae7f-d8fa-4cfe-9766-1ddd13cb14b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd045b7e2-05')
Nov 15 15:45:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Deleting instance files /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f_del
Nov 15 15:45:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Deletion of /opt/stack/data/nova/instances/222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f_del complete
Nov 15 15:45:39 user nova-compute[75095]: INFO nova.compute.manager [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 15:45:39 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.neutron [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Updated VIF entry in instance network info cache for port a041c0dd-ffb7-4dab-abb1-725b74c1892f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG nova.network.neutron [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Updating instance_info_cache with network_info: [{"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a440394-e7f2-40b1-9b04-d8c5d7f82bb9 req-c2af9fc2-52ae-414b-ae05-3fe0d5257e40 service nova] Releasing lock "refresh_cache-9c39762d-35f9-45ef-bbb3-c00bd4adce91" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:45:40 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Took 0.91 seconds to deallocate network for instance.
Nov 15 15:45:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-311aed33-f716-40bb-84cf-69280594ba42 req-3d3b9e88-9b56-4666-a970-2d7c015de8eb service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-deleted-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] Acquiring lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] No waiting events found dispatching network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:40 user nova-compute[75095]: WARNING nova.compute.manager [req-bedb3a9f-f3af-4cd9-a6db-1bb66808ceee req-5848456d-bb22-4d68-89b2-721e5269afaa service nova] [instance: 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f] Received unexpected event network-vif-plugged-d045b7e2-05f1-4c3f-9492-b1a6a7945dc9 for instance with vm_state deleted and task_state None.
Nov 15 15:45:40 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:41 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Deleted allocations for instance 222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2d84c94-ac18-4c27-8397-2f9de9249ac5 tempest-VolumesAssistedSnapshotsTest-1507634686 tempest-VolumesAssistedSnapshotsTest-1507634686-project-member] Lock "222b2e6f-53e0-47b7-a1a2-aea9d5eabb9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.965s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] No waiting events found dispatching network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:41 user nova-compute[75095]: WARNING nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received unexpected event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f for instance with vm_state building and task_state spawning.
Nov 15 15:45:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] No waiting events found dispatching network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:41 user nova-compute[75095]: WARNING nova.compute.manager [req-d03ea439-0243-4f9e-abab-7ca30deb2619 req-338decae-53b2-4959-a5f9-3878c0cfbd45 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received unexpected event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f for instance with vm_state building and task_state spawning.
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:45:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Instance spawned successfully.
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:45:43 user nova-compute[75095]: INFO nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 15 15:45:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:45:43 user nova-compute[75095]: INFO nova.compute.manager [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Took 6.57 seconds to build instance.
Nov 15 15:45:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-743877a6-daa1-4bbb-9d76-f65bbb87d017 tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.663s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d is timed out.
Nov 15 15:45:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully detached device vdc from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the live domain config.
Nov 15 15:45:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KvwLNmon', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:45:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33774f93-8eb5-40e2-94b8-78a043f7578b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:45:49 user nova-compute[75095]: No targets found.
Nov 15 15:45:49 user nova-compute[75095]: iSNS:
Nov 15 15:45:49 user nova-compute[75095]: No targets found.
Nov 15 15:45:49 user nova-compute[75095]: STATIC:
Nov 15 15:45:49 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d
Nov 15 15:45:49 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:49 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:49 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:45:49 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:49 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:49 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:45:49 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:49 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:49 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:45:49 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:45:49 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:45:49 user nova-compute[75095]: FIRMWARE:
Nov 15 15:45:49 user nova-compute[75095]: No targets found.
Nov 15 15:45:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:45:49 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:45:49 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd19df6-47a2-451f-a2b3-7ea45837522c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec2a21b-b82b-488a-906f-d36d472256ad]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d (non-flash)
Nov 15 15:45:49 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:45:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1ff6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[558f4d21-9b39-4375-b680-660d05740221]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac791080-fc71-403c-8576-f93db4db8c96]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed94a85-40e5-4cd2-9d72-108b6fd95999]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abfb515-493e-4e1f-8b06-2b540d7a0dce]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:45:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cb1546-8987-41e6-94eb-33fee937e32c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --logout" returned: 0 in 0.166s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6b2be0-b46d-4ab0-a693-ec4848000cd9]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260]
Nov 15 15:45:50 user nova-compute[75095]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d, portal: 172.16.0.220,3260] successful.
Nov 15 15:45:50 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56b0e0ba-8778-4f95-9a6f-198308b4ba7d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4d6034-8b64-47e5-838a-9a23051a2a38]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== disconnect_volume: return (420ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:45:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c7481cf-7e4d-4be1-8468-8a51cc8cd69e tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.850s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:45:53 user nova-compute[75095]: INFO nova.compute.manager [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] instance snapshotting
Nov 15 15:45:53 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Beginning live snapshot process
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9.delta 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9.delta 1073741824" returned: 0 in 0.061s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:54 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 15:45:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:45:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75563008 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:45:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:45:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 15:45:56 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:45:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9.delta /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9.delta /opt/stack/data/nova/instances/snapshots/tmp8b9stwcq/223f50e1b1aa4831a08402b4e5258de9" returned: 0 in 0.958s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:45:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Snapshot extracted, beginning image upload
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:57 user nova-compute[75095]: INFO nova.compute.manager [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Terminating instance
Nov 15 15:45:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-unplugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-unplugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d949c9f-4183-4d20-a177-9d1680b66ba1 req-40b4d330-d759-4b36-b4dd-a79de267e13d service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-unplugged-6114f792-1084-4110-a522-3e22b0991f20 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:45:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Instance destroyed successfully.
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lazy-loading 'resources' on Instance uuid 82cf5365-8116-43dc-adcf-58006b301b6b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1241390109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1241390109',id=6,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLg0nSZ/fCEu3XAAjgLP9tY2LL2tmc4vp6WK7FZKl1uaj/aWeGVX0TWc4eXFjNM1gGdi0luMBIL9KI1vxXMg/V328fItqjkg1ivAYvFytE/5t86iK6eYtq/CYgdYoX1ZbA==',key_name='tempest-keypair-67025779',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cb8bb4f0ef14c929f8ba8c60295b2ea',ramdisk_id='',reservation_id='r-juakq7a0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-635424622',owner_user_name='tempest-TaggedAttachmentsTest-635424622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb7f652d1ea433a92ffcccf0b93f3b2',uuid=82cf5365-8116-43dc-adcf-58006b301b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converting VIF {"id": "6114f792-1084-4110-a522-3e22b0991f20", "address": "fa:16:3e:36:9f:cd", "network": {"id": "12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1366892124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cb8bb4f0ef14c929f8ba8c60295b2ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6114f792-10", "ovs_interfaceid": "6114f792-1084-4110-a522-3e22b0991f20", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG os_vif [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6114f792-10, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f915cc0f-d756-490e-be02-11b2fc766652) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:45:58 user nova-compute[75095]: INFO os_vif [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:9f:cd,bridge_name='br-int',has_traffic_filtering=True,id=6114f792-1084-4110-a522-3e22b0991f20,network=Network(12e622ba-fc6e-4be9-a2aa-87c7f4d4ffdc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6114f792-10')
Nov 15 15:45:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Deleting instance files /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b_del
Nov 15 15:45:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Deletion of /opt/stack/data/nova/instances/82cf5365-8116-43dc-adcf-58006b301b6b_del complete
Nov 15 15:45:58 user nova-compute[75095]: INFO nova.compute.manager [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 15:45:58 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:45:58 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:00 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Took 1.45 seconds to deallocate network for instance.
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3fbe345-c612-4a50-a440-fd082bc8584f req-b18ca323-8c75-444b-9403-d8003a5651f1 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-deleted-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:00 user nova-compute[75095]: INFO nova.compute.manager [req-e3fbe345-c612-4a50-a440-fd082bc8584f req-b18ca323-8c75-444b-9403-d8003a5651f1 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Neutron deleted interface 6114f792-1084-4110-a522-3e22b0991f20; detaching it from the instance and deleting it from the info cache
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-e3fbe345-c612-4a50-a440-fd082bc8584f req-b18ca323-8c75-444b-9403-d8003a5651f1 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] Acquiring lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] Lock "82cf5365-8116-43dc-adcf-58006b301b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] No waiting events found dispatching network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:00 user nova-compute[75095]: WARNING nova.compute.manager [req-940eca29-66ec-4768-b4ea-919d567f8aca req-c7b87435-0bbb-4986-9bd4-6cd324d77e5f service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Received unexpected event network-vif-plugged-6114f792-1084-4110-a522-3e22b0991f20 for instance with vm_state active and task_state deleting.
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3fbe345-c612-4a50-a440-fd082bc8584f req-b18ca323-8c75-444b-9403-d8003a5651f1 service nova] [instance: 82cf5365-8116-43dc-adcf-58006b301b6b] Detach interface failed, port_id=6114f792-1084-4110-a522-3e22b0991f20, reason: Instance 82cf5365-8116-43dc-adcf-58006b301b6b could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:00 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Deleted allocations for instance 82cf5365-8116-43dc-adcf-58006b301b6b
Nov 15 15:46:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Snapshot image upload complete
Nov 15 15:46:00 user nova-compute[75095]: INFO nova.compute.manager [None req-cb9617cd-ac81-4281-942d-7b84d426989e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Took 7.09 seconds to snapshot the instance on the hypervisor.
Nov 15 15:46:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-65ffec92-707c-43dd-9635-12d88c3a1818 tempest-TaggedAttachmentsTest-635424622 tempest-TaggedAttachmentsTest-635424622-project-member] Lock "82cf5365-8116-43dc-adcf-58006b301b6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.005s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:46:02 user nova-compute[75095]: INFO nova.compute.claims [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Claim successful on node user
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.070s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:46:03 user nova-compute[75095]: INFO nova.compute.claims [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Claim successful on node user
Nov 15 15:46:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:46:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.policy [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975ca4994eb74b6bbf541bb308b148f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c587b1467441ceb091ece4e973408e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:46:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Creating image(s)
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:46:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:46:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG nova.policy [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00d60e3be37a4596befc5bdf2b796c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b022d733d2467d869f76f75385c807', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk 1073741824" returned: 0 in 0.064s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:46:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Creating image(s)
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "/opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "/opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "41baedd14f789787c1feb57cd6b1a561d44e5381" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "41baedd14f789787c1feb57cd6b1a561d44e5381" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.225s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:04 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Successfully created port: 6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Successfully created port: 396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 1.084s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Cannot resize image /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Ensure instance console log exists: /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.virt.images [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] c0e3ff54-f80d-4339-a560-fd039c59a8a4 was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.part /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.part /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.converted" returned: 0 in 0.452s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'flavor' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "41baedd14f789787c1feb57cd6b1a561d44e5381" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.026s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Successfully updated port: 396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquired lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing instance network info cache due to event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] Acquiring lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:06 user nova-compute[75095]: INFO nova.compute.manager [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attaching volume 2ac1bd44-405d-4ea3-ae41-1053133da3ec to /dev/vdb
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json" returned: 0 in 0.208s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "41baedd14f789787c1feb57cd6b1a561d44e5381" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "41baedd14f789787c1feb57cd6b1a561d44e5381" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Successfully updated port: 6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95716c7-1257-430a-9293-9e44777d6873]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-changed-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Refreshing instance network info cache due to event network-changed-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] Acquiring lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] Acquired lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Refreshing network info cache for port 6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912081d-0fe0-4e3f-b3f1-91f4e1beb037]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc9a73e-cf64-4d79-bb04-bb3000ae92d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b8f8a7-0651-4f53-a880-a35c863249c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:46:06 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dae067-10da-4b59-b5c0-3984a0848922]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating existing volume attachment record: 9cf8d22a-ec36-4772-9cf1-1dbd8a66e9ff {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381,backing_fmt=raw /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381,backing_fmt=raw /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk 1073741824" returned: 0 in 0.060s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "41baedd14f789787c1feb57cd6b1a561d44e5381" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating instance_info_cache with network_info: [{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Releasing lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Instance network_info: |[{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dd9947c-52d7-4496-b50c-d69e0b7b54e3 req-fab7f54a-ee34-491d-a2d8-8043d863b266 service nova] Releasing lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] Acquired lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381 --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Ensure instance console log exists: /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Start _get_guest_xml network_info=[{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='df0cf9d9c19b7e9b95378444d985cebe',container_format='bare',created_at=2023-11-15T15:45:54Z,direct_url=<?>,disk_format='qcow2',id=c0e3ff54-f80d-4339-a560-fd039c59a8a4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-668176900',owner='08b022d733d2467d869f76f75385c807',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T15:46:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': 'c0e3ff54-f80d-4339-a560-fd039c59a8a4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:46:06 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:06 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='df0cf9d9c19b7e9b95378444d985cebe',container_format='bare',created_at=2023-11-15T15:45:54Z,direct_url=<?>,disk_format='qcow2',id=c0e3ff54-f80d-4339-a560-fd039c59a8a4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-668176900',owner='08b022d733d2467d869f76f75385c807',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T15:46:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541999983',display_name='tempest-TestStampPattern-server-1541999983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541999983',id=16,image_ref='c0e3ff54-f80d-4339-a560-fd039c59a8a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-fhuou3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37f47320-be8b-4d7a-b8a2-228e4894f881',image_min_disk='1',image_min_ram='0',image_owner_id='08b022d733d2467d869f76f75385c807',image_owner_project_name='tempest-TestStampPattern-1242322391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1242322391-project-member',image_user_id='00d60e3be37a4596befc5bdf2b796c72',network_allocated='True',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:46:04Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=a0cb19cc-854a-48ff-824a-e63294ffd0e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'pci_devices' on Instance uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:46:06 user nova-compute[75095]:   <uuid>a0cb19cc-854a-48ff-824a-e63294ffd0e0</uuid>
Nov 15 15:46:06 user nova-compute[75095]:   <name>instance-00000010</name>
Nov 15 15:46:06 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:46:06 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:46:06 user nova-compute[75095]:   <metadata>
Nov 15 15:46:06 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:46:06 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:name>tempest-TestStampPattern-server-1541999983</nova:name>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:46:06</nova:creationTime>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:46:06 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:46:06 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:owner>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:user uuid="00d60e3be37a4596befc5bdf2b796c72">tempest-TestStampPattern-1242322391-project-member</nova:user>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:project uuid="08b022d733d2467d869f76f75385c807">tempest-TestStampPattern-1242322391</nova:project>
Nov 15 15:46:06 user nova-compute[75095]:       </nova:owner>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:root type="image" uuid="c0e3ff54-f80d-4339-a560-fd039c59a8a4"/>
Nov 15 15:46:06 user nova-compute[75095]:       <nova:ports>
Nov 15 15:46:06 user nova-compute[75095]:         <nova:port uuid="396691c5-ae62-4b09-aada-3de27d35eeeb">
Nov 15 15:46:06 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 15:46:06 user nova-compute[75095]:         </nova:port>
Nov 15 15:46:06 user nova-compute[75095]:       </nova:ports>
Nov 15 15:46:06 user nova-compute[75095]:     </nova:instance>
Nov 15 15:46:06 user nova-compute[75095]:   </metadata>
Nov 15 15:46:06 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:46:06 user nova-compute[75095]:     <system>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="serial">a0cb19cc-854a-48ff-824a-e63294ffd0e0</entry>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="uuid">a0cb19cc-854a-48ff-824a-e63294ffd0e0</entry>
Nov 15 15:46:06 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:46:06 user nova-compute[75095]:     </system>
Nov 15 15:46:06 user nova-compute[75095]:   </sysinfo>
Nov 15 15:46:06 user nova-compute[75095]:   <os>
Nov 15 15:46:06 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:46:06 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:46:06 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:46:06 user nova-compute[75095]:   </os>
Nov 15 15:46:06 user nova-compute[75095]:   <features>
Nov 15 15:46:06 user nova-compute[75095]:     <acpi/>
Nov 15 15:46:06 user nova-compute[75095]:     <apic/>
Nov 15 15:46:06 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:46:06 user nova-compute[75095]:   </features>
Nov 15 15:46:06 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:46:06 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:46:06 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:46:06 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:46:06 user nova-compute[75095]:   </clock>
Nov 15 15:46:06 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:46:06 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:46:06 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:46:06 user nova-compute[75095]:   </cpu>
Nov 15 15:46:06 user nova-compute[75095]:   <devices>
Nov 15 15:46:06 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:46:06 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:46:06 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk"/>
Nov 15 15:46:06 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:46:06 user nova-compute[75095]:     </disk>
Nov 15 15:46:06 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:46:06 user nova-compute[75095]:       <mac address="fa:16:3e:54:85:c0"/>
Nov 15 15:46:06 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:06 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:46:06 user nova-compute[75095]:       <target dev="tap396691c5-ae"/>
Nov 15 15:46:06 user nova-compute[75095]:     </interface>
Nov 15 15:46:06 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:46:06 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/console.log" append="off"/>
Nov 15 15:46:06 user nova-compute[75095]:     </serial>
Nov 15 15:46:06 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:46:06 user nova-compute[75095]:     <video>
Nov 15 15:46:06 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:06 user nova-compute[75095]:     </video>
Nov 15 15:46:06 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:46:06 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:46:06 user nova-compute[75095]:     </rng>
Nov 15 15:46:06 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:46:06 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:46:06 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:46:06 user nova-compute[75095]:     </memballoon>
Nov 15 15:46:06 user nova-compute[75095]:   </devices>
Nov 15 15:46:06 user nova-compute[75095]: </domain>
Nov 15 15:46:06 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541999983',display_name='tempest-TestStampPattern-server-1541999983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541999983',id=16,image_ref='c0e3ff54-f80d-4339-a560-fd039c59a8a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-fhuou3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37f47320-be8b-4d7a-b8a2-228e4894f881',image_min_disk='1',image_min_ram='0',image_owner_id='08b022d733d2467d869f76f75385c807',image_owner_project_name='tempest-TestStampPattern-1242322391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1242322391-project-member',image_user_id='00d60e3be37a4596befc5bdf2b796c72',network_allocated='True',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:46:04Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=a0cb19cc-854a-48ff-824a-e63294ffd0e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG os_vif [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c3906d0-80f1-54bc-8f11-71a6d2bfbe8e', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap396691c5-ae, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap396691c5-ae, col_values=(('qos', UUID('e12ada46-1613-4e23-9e9c-0a0a2c9c8e2e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap396691c5-ae, col_values=(('external_ids', {'iface-id': '396691c5-ae62-4b09-aada-3de27d35eeeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:85:c0', 'vm-uuid': 'a0cb19cc-854a-48ff-824a-e63294ffd0e0'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:06 user nova-compute[75095]: INFO os_vif [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae')
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No VIF found with MAC fa:16:3e:54:85:c0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating instance_info_cache with network_info: [{"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance network_info: |[{"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start _get_guest_xml network_info=[{"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:46:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updated VIF entry in instance network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating instance_info_cache with network_info: [{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-tempest.common.compute-instance-699262549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'pci_devices' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1e2dbe5f-3e74-46a5-a477-32ecb995686a req-1a32cc55-738b-43cb-8a8e-1d87dbcae35f service nova] Releasing lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:46:07 user nova-compute[75095]:   <uuid>497c558c-8e03-4dd5-ab88-8df09337e0fa</uuid>
Nov 15 15:46:07 user nova-compute[75095]:   <name>instance-0000000f</name>
Nov 15 15:46:07 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:46:07 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:46:07 user nova-compute[75095]:   <metadata>
Nov 15 15:46:07 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:46:07 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:name>tempest-tempest.common.compute-instance-699262549</nova:name>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:46:07</nova:creationTime>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:46:07 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:46:07 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:owner>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:user uuid="975ca4994eb74b6bbf541bb308b148f1">tempest-ServerActionsTestOtherA-440053215-project-member</nova:user>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:project uuid="18c587b1467441ceb091ece4e973408e">tempest-ServerActionsTestOtherA-440053215</nova:project>
Nov 15 15:46:07 user nova-compute[75095]:       </nova:owner>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:46:07 user nova-compute[75095]:       <nova:ports>
Nov 15 15:46:07 user nova-compute[75095]:         <nova:port uuid="6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6">
Nov 15 15:46:07 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:46:07 user nova-compute[75095]:         </nova:port>
Nov 15 15:46:07 user nova-compute[75095]:       </nova:ports>
Nov 15 15:46:07 user nova-compute[75095]:     </nova:instance>
Nov 15 15:46:07 user nova-compute[75095]:   </metadata>
Nov 15 15:46:07 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:46:07 user nova-compute[75095]:     <system>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="serial">497c558c-8e03-4dd5-ab88-8df09337e0fa</entry>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="uuid">497c558c-8e03-4dd5-ab88-8df09337e0fa</entry>
Nov 15 15:46:07 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:46:07 user nova-compute[75095]:     </system>
Nov 15 15:46:07 user nova-compute[75095]:   </sysinfo>
Nov 15 15:46:07 user nova-compute[75095]:   <os>
Nov 15 15:46:07 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:46:07 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:46:07 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:46:07 user nova-compute[75095]:   </os>
Nov 15 15:46:07 user nova-compute[75095]:   <features>
Nov 15 15:46:07 user nova-compute[75095]:     <acpi/>
Nov 15 15:46:07 user nova-compute[75095]:     <apic/>
Nov 15 15:46:07 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:46:07 user nova-compute[75095]:   </features>
Nov 15 15:46:07 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:46:07 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:46:07 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:46:07 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:46:07 user nova-compute[75095]:   </clock>
Nov 15 15:46:07 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:46:07 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:46:07 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:46:07 user nova-compute[75095]:   </cpu>
Nov 15 15:46:07 user nova-compute[75095]:   <devices>
Nov 15 15:46:07 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:46:07 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:46:07 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk"/>
Nov 15 15:46:07 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:46:07 user nova-compute[75095]:     </disk>
Nov 15 15:46:07 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:46:07 user nova-compute[75095]:       <mac address="fa:16:3e:5e:cc:2c"/>
Nov 15 15:46:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:07 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:46:07 user nova-compute[75095]:       <target dev="tap6a39a1cd-8a"/>
Nov 15 15:46:07 user nova-compute[75095]:     </interface>
Nov 15 15:46:07 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:46:07 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/console.log" append="off"/>
Nov 15 15:46:07 user nova-compute[75095]:     </serial>
Nov 15 15:46:07 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:46:07 user nova-compute[75095]:     <video>
Nov 15 15:46:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:07 user nova-compute[75095]:     </video>
Nov 15 15:46:07 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:46:07 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:46:07 user nova-compute[75095]:     </rng>
Nov 15 15:46:07 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:46:07 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:46:07 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:46:07 user nova-compute[75095]:     </memballoon>
Nov 15 15:46:07 user nova-compute[75095]:   </devices>
Nov 15 15:46:07 user nova-compute[75095]: </domain>
Nov 15 15:46:07 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-tempest.common.compute-instance-699262549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG os_vif [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddc715ec-7abd-5f68-b00d-7a3821933526', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a39a1cd-8a, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a39a1cd-8a, col_values=(('qos', UUID('64756284-bf69-4b2a-bce7-8dbd95a55497')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a39a1cd-8a, col_values=(('external_ids', {'iface-id': '6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:cc:2c', 'vm-uuid': '497c558c-8e03-4dd5-ab88-8df09337e0fa'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:07 user nova-compute[75095]: INFO os_vif [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a')
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:5e:cc:2c, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:46:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] No waiting events found dispatching network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:09 user nova-compute[75095]: WARNING nova.compute.manager [req-d8731ffb-9f86-4b0e-bd3e-0334ca99b189 req-61149741-96f2-46ad-8619-ee3c8c77ac18 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received unexpected event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb for instance with vm_state building and task_state spawning.
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:10 user nova-compute[75095]: WARNING nova.compute.manager [req-8ad38265-c219-448b-b068-e258f4a64223 req-c1bd6ee6-59d6-4574-8a04-1ec8909798c8 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state building and task_state spawning.
Nov 15 15:46:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:46:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] No waiting events found dispatching network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:11 user nova-compute[75095]: WARNING nova.compute.manager [req-d3502389-b022-4586-bbca-07def6497d1d req-4dac4178-1218-4ee2-94a3-3528370fee79 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received unexpected event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb for instance with vm_state building and task_state spawning.
Nov 15 15:46:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:46:11 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:11 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:11 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e2cf47-8021-4195-bcfa-e53c17327778]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:46:11 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6dec32-276d-42b9-914a-a8b29d1b6c6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec] added
Nov 15 15:46:11 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc38f4a-39a8-4597-8bae-47727d7119a1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf7c779-72c9-4a14-8c6c-d4dec1e647db]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAvwTrHG {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAvwTrHG" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62695a5-fc13-43b5-bec9-827ba284bec0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAvwTrHG'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[597c468e-6261-43c2-b610-a08bef3c39e9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d02f1fa-efbb-4aff-b870-4c9dce191d48]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:12 user nova-compute[75095]: WARNING nova.compute.manager [req-b0484126-8868-4699-85f3-70dcc3c7ebc4 req-e0823759-493a-4403-9a64-03718a977429 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state building and task_state spawning.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0939f1ab-42c9-4b13-bec8-318b79b9130e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260]
Nov 15 15:46:12 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260] successful.
Nov 15 15:46:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[189cc0c5-647a-458f-9bbd-2cbf256a14b9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance spawned successfully.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d9932-9540-4217-939e-e6ae6a099960]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:12 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Instance spawned successfully.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15189cd-683a-44f3-ab74-dec49786e070]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Took 9.00 seconds to spawn the instance on the hypervisor.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Took 8.43 seconds to spawn the instance on the hypervisor.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.compute.manager [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Took 9.89 seconds to build instance.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f35c660a-113a-43e7-a2f4-1c39a16a26a6 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:12 user nova-compute[75095]: INFO nova.compute.manager [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Took 9.51 seconds to build instance.
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-735298d4-5967-40d5-a4f6-558ed9bb8d6e tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.628s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:46:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23761363436323739', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761363436323739', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'flavor' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:46:13 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:46:13 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:46:13 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:46:13 user nova-compute[75095]:   <serial>2ac1bd44-405d-4ea3-ae41-1053133da3ec</serial>
Nov 15 15:46:13 user nova-compute[75095]: </disk>
Nov 15 15:46:13 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No VIF found with MAC fa:16:3e:e5:60:f6, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcc1ba1e-d0d8-454a-9dc0-c01bb50e1438 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.846s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:15 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:15 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:15 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7407MB free_disk=24.618114471435547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:46:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:15 user nova-compute[75095]: INFO nova.compute.manager [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Rescuing
Nov 15 15:46:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:46:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:46:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:46:15 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Applying migration context for instance 7447d0b9-3152-49ab-8576-994810c20e29 as it has an incoming, in-progress migration 01477937-a7af-40c0-b3c8-e73b62d22814. Migration status is finished {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 15:46:15 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating resource usage from migration 01477937-a7af-40c0-b3c8-e73b62d22814
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance da2d8479-bd97-40d2-9fea-e3a979b21a1f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Migration 01477937-a7af-40c0-b3c8-e73b62d22814 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9c39762d-35f9-45ef-bbb3-c00bd4adce91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:17 user nova-compute[75095]: WARNING nova.compute.manager [req-4e197f3f-8525-4a20-ba19-c62780380067 req-1621271e-3c0c-424c-8bf7-8507c35c2df8 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance destroyed successfully.
Nov 15 15:46:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attempting a stable device rescue
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:46:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Creating image(s)
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'trusted_certs' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "faa73d47f732f09f96da93069e1181c6ac6df35b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "faa73d47f732f09f96da93069e1181c6ac6df35b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.part --force-share --output=json" returned: 0 in 0.226s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG nova.virt.images [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] b80c7f74-49b9-4c6d-a2f8-d5b654ddefac was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:46:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.part /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:19 user nova-compute[75095]: WARNING nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:19 user nova-compute[75095]: WARNING nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:19 user nova-compute[75095]: WARNING nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:19 user nova-compute[75095]: WARNING nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:19 user nova-compute[75095]: WARNING nova.compute.manager [req-50b9bd6c-044e-42de-a870-205e66358ce3 req-addfec63-65bd-459c-a367-6310d7d6fdd0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.part /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.converted" returned: 0 in 0.769s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "faa73d47f732f09f96da93069e1181c6ac6df35b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.282s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "faa73d47f732f09f96da93069e1181c6ac6df35b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "faa73d47f732f09f96da93069e1181c6ac6df35b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:20 user nova-compute[75095]: INFO nova.compute.manager [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Detaching volume 8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b --force-share --output=json" returned: 0 in 0.200s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b,backing_fmt=raw /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: INFO nova.virt.block_device [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Attempting to driver detach volume 8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd from mountpoint /dev/vdb
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b,backing_fmt=raw /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue" returned: 0 in 0.081s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "faa73d47f732f09f96da93069e1181c6ac6df35b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'migration_context' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Attempting to detach device vdb from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:46:20 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:46:20 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:46:20 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:   <serial>8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd</serial>
Nov 15 15:46:20 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:46:20 user nova-compute[75095]: </disk>
Nov 15 15:46:20 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:46:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully detached device vdb from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the persistent domain config.
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:46:20 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:46:20 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:46:20 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:   <serial>8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd</serial>
Nov 15 15:46:20 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:46:20 user nova-compute[75095]: </disk>
Nov 15 15:46:20 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Object Instance<f8acca60-e3f3-412e-bf0f-023ed2943bfc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start _get_guest_xml network_info=[{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "vif_mac": "fa:16:3e:e5:60:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b80c7f74-49b9-4c6d-a2f8-d5b654ddefac', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '9cf8d22a-ec36-4772-9cf1-1dbd8a66e9ff', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f8acca60-e3f3-412e-bf0f-023ed2943bfc', 'attached_at': '', 'detached_at': '', 'volume_id': '2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'serial': '2ac1bd44-405d-4ea3-ae41-1053133da3ec'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'resources' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Object Instance<f8acca60-e3f3-412e-bf0f-023ed2943bfc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'numa_topology' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Object Instance<f8acca60-e3f3-412e-bf0f-023ed2943bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:46:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'vcpu_model' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Object Instance<f8acca60-e3f3-412e-bf0f-023ed2943bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:46:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:20 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b254d87-8502-49ab-adc0-035fab380bd6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NAvwTrHG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 15:46:20 user nova-compute[75095]: node.name = iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:46:20 user nova-compute[75095]: node.tpgt = -1
Nov 15 15:46:20 user nova-compute[75095]: node.startup = automatic
Nov 15 15:46:20 user nova-compute[75095]: node.leading_login = No
Nov 15 15:46:20 user nova-compute[75095]: iface.iscsi_ifacename = default
Nov 15 15:46:20 user nova-compute[75095]: iface.net_ifacename = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.ipaddress = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.prefix_len = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.hwaddress = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.transport_name = tcp
Nov 15 15:46:20 user nova-compute[75095]: iface.initiatorname = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.vlan_id = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.vlan_priority = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.vlan_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.iface_num = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.mtu = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.port = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.bootproto = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.subnet_mask = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.gateway = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_alt_client_id = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_dns = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_learn_iqn = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_vendor_id_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_vendor_id = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.dhcp_slp_da = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.fragmentation = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.gratuitous_arp = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.incoming_forwarding = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.tos_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.tos = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.ttl = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.delayed_ack = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.tcp_nagle = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.tcp_wsf_state = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.tcp_wsf = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.tcp_timer_scale = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.tcp_timestamp = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.redirect = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.def_task_mgmt_timeout = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.header_digest = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.data_digest = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.immediate_data = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.initial_r2t = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.data_seq_inorder = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.data_pdu_inorder = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.erl = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.max_receive_data_len = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.first_burst_len = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.max_outstanding_r2t = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.max_burst_len = 0
Nov 15 15:46:20 user nova-compute[75095]: iface.chap_auth = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.bidi_chap = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.strict_login_compliance = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.discovery_auth = <empty>
Nov 15 15:46:20 user nova-compute[75095]: iface.discovery_logout = <empty>
Nov 15 15:46:20 user nova-compute[75095]: node.discovery_address = <empty>
Nov 15 15:46:20 user nova-compute[75095]: node.discovery_port = 0
Nov 15 15:46:20 user nova-compute[75095]: node.discovery_type = static
Nov 15 15:46:20 user nova-compute[75095]: node.session.initial_cmdsn = 0
Nov 15 15:46:20 user nova-compute[75095]: node.session.initial_login_retry_max = 8
Nov 15 15:46:20 user nova-compute[75095]: node.session.xmit_thread_priority = -20
Nov 15 15:46:20 user nova-compute[75095]: node.session.cmds_max = 128
Nov 15 15:46:20 user nova-compute[75095]: node.session.queue_depth = 32
Nov 15 15:46:20 user nova-compute[75095]: node.session.nr_sessions = 1
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.authmethod = CHAP
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.username = NAvwTrHG
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.password = ***
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.username_in = <empty>
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.password_in = <empty>
Nov 15 15:46:20 user nova-compute[75095]: node.session.auth.chap_algs = MD5
Nov 15 15:46:20 user nova-compute[75095]: node.session.timeo.replacement_timeout = 120
Nov 15 15:46:20 user nova-compute[75095]: node.session.err_timeo.abort_timeout = 15
Nov 15 15:46:20 user nova-compute[75095]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 15:46:20 user nova-compute[75095]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 15:46:20 user nova-compute[75095]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.FastAbort = Yes
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.InitialR2T = No
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.ImmediateData = Yes
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.MaxConnections = 1
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 15:46:20 user nova-compute[75095]: node.session.iscsi.ERL = 0
Nov 15 15:46:20 user nova-compute[75095]: node.session.scan = manual
Nov 15 15:46:20 user nova-compute[75095]: node.session.reopen_max = 0
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].address = 172.16.0.220
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].port = 3260
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].startup = manual
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].tcp.window_size = 524288
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].tcp.type_of_service = 0
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].timeo.logout_timeout = 15
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].timeo.login_timeout = 15
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].timeo.auth_timeout = 45
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.DataDigest = None
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.IFMarker = No
Nov 15 15:46:20 user nova-compute[75095]: node.conn[0].iscsi.OFMarker = No
Nov 15 15:46:20 user nova-compute[75095]: # END RECORD
Nov 15 15:46:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e5eb1-10a4-46ee-a477-925846f7ac9a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5373e8ad-072e-48c8-929b-83fa51178a70]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAvwTrHG {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NAvwTrHG" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ded94aa-f23b-4c04-87d0-3bc461e29b50]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NAvwTrHG'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[466fbd02-a859-4b15-bb88-4dfa1ad8f38c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b08f922-9e40-4062-a47c-a4256baf63da]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:20 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.189s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea672888-723f-4432-af03-027490f0ca56]: (4, ('0 0 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.214s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] <== connect_volume: return (217ms) {'type': 'block', 'scsi_wwn': '23761363436323739', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761363436323739', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1967741566',display_name='tempest-ServerStableDeviceRescueTest-server-1967741566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1967741566',id=4,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBUOIfdbDk/brXXiylka2/btdkrjY3diz7DKadf13/ZIXcRbgTpOTtE06UY9cDwKBRHgGAHt69/VENIJfjafbfdolZpGClTyfIfX148jIcxUAMRahY1njiu0GNtx6ilXg==',key_name='tempest-keypair-112033150',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ed810aaa216455bb359448237bb716b',ramdisk_id='',reservation_id='r-m4a5wyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1847037719',owner_user_name='tempest-ServerStableDeviceRescueTest-1847037719-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b18bf4b448346beaea19f95e59ea778',uuid=f8acca60-e3f3-412e-bf0f-023ed2943bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "vif_mac": "fa:16:3e:e5:60:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converting VIF {"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "vif_mac": "fa:16:3e:e5:60:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'pci_devices' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Object Instance<f8acca60-e3f3-412e-bf0f-023ed2943bfc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:46:20 user nova-compute[75095]:   <uuid>f8acca60-e3f3-412e-bf0f-023ed2943bfc</uuid>
Nov 15 15:46:20 user nova-compute[75095]:   <name>instance-00000004</name>
Nov 15 15:46:20 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:46:20 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:46:20 user nova-compute[75095]:   <metadata>
Nov 15 15:46:20 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:46:20 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1967741566</nova:name>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:46:20</nova:creationTime>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:46:20 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:46:20 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:owner>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:user uuid="1b18bf4b448346beaea19f95e59ea778">tempest-ServerStableDeviceRescueTest-1847037719-project-member</nova:user>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:project uuid="5ed810aaa216455bb359448237bb716b">tempest-ServerStableDeviceRescueTest-1847037719</nova:project>
Nov 15 15:46:20 user nova-compute[75095]:       </nova:owner>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:46:20 user nova-compute[75095]:       <nova:ports>
Nov 15 15:46:20 user nova-compute[75095]:         <nova:port uuid="b8c2c859-3325-4d81-a66f-fb84a4115cfd">
Nov 15 15:46:20 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 15:46:20 user nova-compute[75095]:         </nova:port>
Nov 15 15:46:20 user nova-compute[75095]:       </nova:ports>
Nov 15 15:46:20 user nova-compute[75095]:     </nova:instance>
Nov 15 15:46:20 user nova-compute[75095]:   </metadata>
Nov 15 15:46:20 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:46:20 user nova-compute[75095]:     <system>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="serial">f8acca60-e3f3-412e-bf0f-023ed2943bfc</entry>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="uuid">f8acca60-e3f3-412e-bf0f-023ed2943bfc</entry>
Nov 15 15:46:20 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:46:20 user nova-compute[75095]:     </system>
Nov 15 15:46:20 user nova-compute[75095]:   </sysinfo>
Nov 15 15:46:20 user nova-compute[75095]:   <os>
Nov 15 15:46:20 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:46:20 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:46:20 user nova-compute[75095]:   </os>
Nov 15 15:46:20 user nova-compute[75095]:   <features>
Nov 15 15:46:20 user nova-compute[75095]:     <acpi/>
Nov 15 15:46:20 user nova-compute[75095]:     <apic/>
Nov 15 15:46:20 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:46:20 user nova-compute[75095]:   </features>
Nov 15 15:46:20 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:46:20 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:46:20 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:46:20 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:46:20 user nova-compute[75095]:   </clock>
Nov 15 15:46:20 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:46:20 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:46:20 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:46:20 user nova-compute[75095]:   </cpu>
Nov 15 15:46:20 user nova-compute[75095]:   <devices>
Nov 15 15:46:20 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:46:20 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:46:20 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk"/>
Nov 15 15:46:20 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:     </disk>
Nov 15 15:46:20 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:46:20 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:46:20 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:46:20 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:       <serial>2ac1bd44-405d-4ea3-ae41-1053133da3ec</serial>
Nov 15 15:46:20 user nova-compute[75095]:     </disk>
Nov 15 15:46:20 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:46:20 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:46:20 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue"/>
Nov 15 15:46:20 user nova-compute[75095]:       <target dev="vdc" bus="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:       <boot order="1"/>
Nov 15 15:46:20 user nova-compute[75095]:     </disk>
Nov 15 15:46:20 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:46:20 user nova-compute[75095]:       <mac address="fa:16:3e:e5:60:f6"/>
Nov 15 15:46:20 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:46:20 user nova-compute[75095]:       <target dev="tapb8c2c859-33"/>
Nov 15 15:46:20 user nova-compute[75095]:     </interface>
Nov 15 15:46:20 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:46:20 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/console.log" append="off"/>
Nov 15 15:46:20 user nova-compute[75095]:     </serial>
Nov 15 15:46:20 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:46:20 user nova-compute[75095]:     <video>
Nov 15 15:46:20 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:46:20 user nova-compute[75095]:     </video>
Nov 15 15:46:20 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:46:20 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:46:20 user nova-compute[75095]:     </rng>
Nov 15 15:46:20 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:46:20 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:46:20 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:46:20 user nova-compute[75095]:     </memballoon>
Nov 15 15:46:20 user nova-compute[75095]:   </devices>
Nov 15 15:46:20 user nova-compute[75095]: </domain>
Nov 15 15:46:20 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:46:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance destroyed successfully.
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] No VIF found with MAC fa:16:3e:e5:60:f6, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:46:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:22 user nova-compute[75095]: WARNING nova.compute.manager [req-c91b6225-ae47-4542-b46e-2a12fb5deafa req-a8c4f545-4b4b-4aa2-b4d5-08cc2ebe4c7f service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-420dc0bc-c00b-457b-ae58-2a4bcd996e00 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:24 user nova-compute[75095]: WARNING nova.compute.manager [req-17144df0-280b-4aa9-bb32-368c3f2dc7dd req-e61617e4-f4d5-4626-8728-935603ec39a3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state active and task_state rescuing.
Nov 15 15:46:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:30 user nova-compute[75095]: INFO nova.compute.manager [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Terminating instance
Nov 15 15:46:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-a2333aca-2a7d-443d-8108-f9f8d21c3879 req-dc45f5ed-a9f7-4717-82d2-36760e153a2e service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-unplugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:46:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Instance destroyed successfully.
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.objects.instance [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lazy-loading 'resources' on Instance uuid da2d8479-bd97-40d2-9fea-e3a979b21a1f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:42:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-503687833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1458208636',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZuL0lKSeQSmfKmIBc0y4wjQIUYc/kbj7nBhYoRizDL8V3tEg42nmwefDg19ixWeBGL15mxKkyqXiMN6ZaAG6o6DJ7dWAFawgN0oxQWIMw3wsl2m94YQ81exO6szKGNkA==',key_name='tempest-keypair-624131362',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bae3e7bf05d46c48aab837a23446af4',ramdisk_id='',reservation_id='r-ih0bv73k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-454148145',owner_user_name='tempest-ServerActionsV293TestJSON-454148145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967d134fe5cb41aaa8181e8372724dd7',uuid=da2d8479-bd97-40d2-9fea-e3a979b21a1f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converting VIF {"id": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "address": "fa:16:3e:85:8a:71", "network": {"id": "64527e24-1c84-465f-bb54-ef7414b3c4df", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1932305394-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bae3e7bf05d46c48aab837a23446af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e9fbda9-5b", "ovs_interfaceid": "1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_vif [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e9fbda9-5b, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=96b14c26-511e-4621-84b3-95a2ca77101e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:31 user nova-compute[75095]: INFO os_vif [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:8a:71,bridge_name='br-int',has_traffic_filtering=True,id=1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d,network=Network(64527e24-1c84-465f-bb54-ef7414b3c4df),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e9fbda9-5b')
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sbLheKox', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:46:31 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f647a9-e6f7-4ce7-9171-b2a6fd418beb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:46:31 user nova-compute[75095]: No targets found.
Nov 15 15:46:31 user nova-compute[75095]: iSNS:
Nov 15 15:46:31 user nova-compute[75095]: No targets found.
Nov 15 15:46:31 user nova-compute[75095]: STATIC:
Nov 15 15:46:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d
Nov 15 15:46:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:46:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:46:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:46:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:31 user nova-compute[75095]: FIRMWARE:
Nov 15 15:46:31 user nova-compute[75095]: No targets found.
Nov 15 15:46:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:46:31 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:46:31 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae051b83-9935-480e-8eef-526f3e302111]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f53a019-3290-4f68-b1ff-f09315e618fe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:31 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1ff250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d'): ({'sdh'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Removing single pathed devices sdh {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c2d791-4c3e-4b22-a6b9-912dcb2af5d7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64cd39-decb-4c48-b497-383dd1b1d8f0]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Flushing IO for device /dev/sdh {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1134deb6-4da8-4b97-98c1-612580f9fb5a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0eaf86-4d65-4f35-abc3-e4cc21a7704b]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] SCSI volumes sdh have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[876695ad-0cc2-4295-b89b-cf43cb098f48]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35b3c6-3aaa-4f62-aac7-a666ec8b0881]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260]
Nov 15 15:46:31 user nova-compute[75095]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d, portal: 172.16.0.220,3260] successful.
Nov 15 15:46:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c7f5944-102a-48ee-a60e-976f2b73357d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba89c88b-ac78-4fd7-8a3a-b3a732032a86]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] <== disconnect_volume: return (342ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:46:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:46:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deleting instance files /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f_del
Nov 15 15:46:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deletion of /opt/stack/data/nova/instances/da2d8479-bd97-40d2-9fea-e3a979b21a1f_del complete
Nov 15 15:46:32 user nova-compute[75095]: INFO nova.compute.manager [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 15 15:46:32 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:46:32 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Took 0.86 seconds to deallocate network for instance.
Nov 15 15:46:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] Acquiring lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] No waiting events found dispatching network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:46:33 user nova-compute[75095]: WARNING nova.compute.manager [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received unexpected event network-vif-plugged-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d for instance with vm_state active and task_state deleting.
Nov 15 15:46:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-33dbf068-8dc2-4d5b-9a3e-2c1e9d7eb134 req-c4047cc7-4d2a-4ad0-b846-ab9dff06aac6 service nova] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Received event network-vif-deleted-1e9fbda9-5bf6-4f29-ab04-4607d0a15e3d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:46:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:34 user nova-compute[75095]: INFO nova.compute.manager [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Took 1.63 seconds to detach 1 volumes for instance.
Nov 15 15:46:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] [instance: da2d8479-bd97-40d2-9fea-e3a979b21a1f] Deleting volume: 9c7f5944-102a-48ee-a60e-976f2b73357d {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 15:46:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:46:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:46:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:46:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:46:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:35 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Deleted allocations for instance da2d8479-bd97-40d2-9fea-e3a979b21a1f
Nov 15 15:46:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-412f72a6-6a69-4811-a7f2-c0e65f543350 tempest-ServerActionsV293TestJSON-454148145 tempest-ServerActionsV293TestJSON-454148145-project-member] Lock "da2d8479-bd97-40d2-9fea-e3a979b21a1f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.626s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d is timed out.
Nov 15 15:46:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully detached device vdb from instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d from the live domain config.
Nov 15 15:46:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUjcezVH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:46:40 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[838634ee-44d8-40c8-a887-7fc18f4b1bd9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:46:40 user nova-compute[75095]: No targets found.
Nov 15 15:46:40 user nova-compute[75095]: iSNS:
Nov 15 15:46:40 user nova-compute[75095]: No targets found.
Nov 15 15:46:40 user nova-compute[75095]: STATIC:
Nov 15 15:46:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:46:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd
Nov 15 15:46:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:40 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:46:40 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:46:40 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:46:40 user nova-compute[75095]: FIRMWARE:
Nov 15 15:46:40 user nova-compute[75095]: No targets found.
Nov 15 15:46:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:46:40 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:46:40 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[22beaab4-ea3d-4a25-85f6-2f8d25179494]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4653f300-38f1-46f9-8076-d38b8431090c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:40 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:40 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd (non-flash)
Nov 15 15:46:40 user nova-compute[75095]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:46:40 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:46:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1fc9d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:46:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e2016-33fa-49a2-a285-f18d9cfb64f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f684b2-050d-40f6-8a3c-fa467932f646]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5622390b-69ca-43ec-81e5-0ff0053c8bd6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[014b095e-966a-4128-9bdf-fa2c58173dd0]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83055e7-b5c8-4cb7-9de5-d16f3dd45081]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fba7923-1c38-48a2-ae21-af3277d6d194]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260]
Nov 15 15:46:41 user nova-compute[75095]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd, portal: 172.16.0.220,3260] successful.
Nov 15 15:46:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f0dc9d9-3ed7-44ec-b2fa-ac6f23376ebd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[de77aa74-db95-4d20-bc8d-8336aee0b817]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] <== disconnect_volume: return (330ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:41 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'flavor' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:46:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0f93fb6b-003a-4894-9c77-61b358e03223 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.866s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:46:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:46:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:47:05 user nova-compute[75095]: INFO nova.compute.claims [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Claim successful on node user
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:47:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:47:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Creating image(s)
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "/opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "/opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:05 user nova-compute[75095]: DEBUG nova.policy [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9c27fe2e0e74192975c7544bf9bda40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aa49b704e264842bcbd046383a6deda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk 1073741824" returned: 0 in 0.054s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Cannot resize image /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Ensure instance console log exists: /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Successfully created port: 0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:47:07 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Successfully updated port: 0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquired lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-changed-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Refreshing instance network info cache due to event network-changed-0f3ba2b5-c398-451e-a695-7dbcaf3c3363. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] Acquiring lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updating instance_info_cache with network_info: [{"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:47:08 user nova-compute[75095]: INFO nova.compute.claims [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Claim successful on node user
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Releasing lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Instance network_info: |[{"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] Acquired lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Refreshing network info cache for port 0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Start _get_guest_xml network_info=[{"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:47:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-175315261',display_name='tempest-TestVolumeSwap-server-175315261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-175315261',id=17,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMd2GKBnOW4kJjTDDoO26RAlmtRtih5DtjoOaW7ixZr3py37PGzGvsPhCfUpgP+ugIdM0ySuGTioW22wvwN2/vjITd3gaFvFJaJ8tLD/qttN5Fgmztob2uxbeh1Int15g==',key_name='tempest-keypair-672407940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa49b704e264842bcbd046383a6deda',ramdisk_id='',reservation_id='r-245dxl1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1791544710',owner_user_name='tempest-TestVolumeSwap-1791544710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c27fe2e0e74192975c7544bf9bda40',uuid=ac60b17f-c938-4031-a439-e28d8563dc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converting VIF {"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lazy-loading 'pci_devices' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:47:09 user nova-compute[75095]:   <uuid>ac60b17f-c938-4031-a439-e28d8563dc75</uuid>
Nov 15 15:47:09 user nova-compute[75095]:   <name>instance-00000011</name>
Nov 15 15:47:09 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:47:09 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:47:09 user nova-compute[75095]:   <metadata>
Nov 15 15:47:09 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:47:09 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:name>tempest-TestVolumeSwap-server-175315261</nova:name>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:47:08</nova:creationTime>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:47:09 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:47:09 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:owner>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:user uuid="f9c27fe2e0e74192975c7544bf9bda40">tempest-TestVolumeSwap-1791544710-project-member</nova:user>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:project uuid="3aa49b704e264842bcbd046383a6deda">tempest-TestVolumeSwap-1791544710</nova:project>
Nov 15 15:47:09 user nova-compute[75095]:       </nova:owner>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:47:09 user nova-compute[75095]:       <nova:ports>
Nov 15 15:47:09 user nova-compute[75095]:         <nova:port uuid="0f3ba2b5-c398-451e-a695-7dbcaf3c3363">
Nov 15 15:47:09 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 15:47:09 user nova-compute[75095]:         </nova:port>
Nov 15 15:47:09 user nova-compute[75095]:       </nova:ports>
Nov 15 15:47:09 user nova-compute[75095]:     </nova:instance>
Nov 15 15:47:09 user nova-compute[75095]:   </metadata>
Nov 15 15:47:09 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:47:09 user nova-compute[75095]:     <system>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="serial">ac60b17f-c938-4031-a439-e28d8563dc75</entry>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="uuid">ac60b17f-c938-4031-a439-e28d8563dc75</entry>
Nov 15 15:47:09 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:47:09 user nova-compute[75095]:     </system>
Nov 15 15:47:09 user nova-compute[75095]:   </sysinfo>
Nov 15 15:47:09 user nova-compute[75095]:   <os>
Nov 15 15:47:09 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:47:09 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:47:09 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:47:09 user nova-compute[75095]:   </os>
Nov 15 15:47:09 user nova-compute[75095]:   <features>
Nov 15 15:47:09 user nova-compute[75095]:     <acpi/>
Nov 15 15:47:09 user nova-compute[75095]:     <apic/>
Nov 15 15:47:09 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:47:09 user nova-compute[75095]:   </features>
Nov 15 15:47:09 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:47:09 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:47:09 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:47:09 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:47:09 user nova-compute[75095]:   </clock>
Nov 15 15:47:09 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:47:09 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:47:09 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:47:09 user nova-compute[75095]:   </cpu>
Nov 15 15:47:09 user nova-compute[75095]:   <devices>
Nov 15 15:47:09 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:47:09 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:47:09 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk"/>
Nov 15 15:47:09 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:47:09 user nova-compute[75095]:     </disk>
Nov 15 15:47:09 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:47:09 user nova-compute[75095]:       <mac address="fa:16:3e:f4:71:3e"/>
Nov 15 15:47:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:09 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:47:09 user nova-compute[75095]:       <target dev="tap0f3ba2b5-c3"/>
Nov 15 15:47:09 user nova-compute[75095]:     </interface>
Nov 15 15:47:09 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:47:09 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/console.log" append="off"/>
Nov 15 15:47:09 user nova-compute[75095]:     </serial>
Nov 15 15:47:09 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:47:09 user nova-compute[75095]:     <video>
Nov 15 15:47:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:09 user nova-compute[75095]:     </video>
Nov 15 15:47:09 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:47:09 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:47:09 user nova-compute[75095]:     </rng>
Nov 15 15:47:09 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:47:09 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:47:09 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:47:09 user nova-compute[75095]:     </memballoon>
Nov 15 15:47:09 user nova-compute[75095]:   </devices>
Nov 15 15:47:09 user nova-compute[75095]: </domain>
Nov 15 15:47:09 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-175315261',display_name='tempest-TestVolumeSwap-server-175315261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-175315261',id=17,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMd2GKBnOW4kJjTDDoO26RAlmtRtih5DtjoOaW7ixZr3py37PGzGvsPhCfUpgP+ugIdM0ySuGTioW22wvwN2/vjITd3gaFvFJaJ8tLD/qttN5Fgmztob2uxbeh1Int15g==',key_name='tempest-keypair-672407940',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3aa49b704e264842bcbd046383a6deda',ramdisk_id='',reservation_id='r-245dxl1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1791544710',owner_user_name='tempest-TestVolumeSwap-1791544710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c27fe2e0e74192975c7544bf9bda40',uuid=ac60b17f-c938-4031-a439-e28d8563dc75,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converting VIF {"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG os_vif [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68bb94d0-2105-5712-a4de-e86ea3972ba8', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f3ba2b5-c3, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f3ba2b5-c3, col_values=(('qos', UUID('378509e1-c4b5-4c7b-8fb5-a24c03c0f438')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f3ba2b5-c3, col_values=(('external_ids', {'iface-id': '0f3ba2b5-c398-451e-a695-7dbcaf3c3363', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:71:3e', 'vm-uuid': 'ac60b17f-c938-4031-a439-e28d8563dc75'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:09 user nova-compute[75095]: INFO os_vif [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3')
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] No VIF found with MAC fa:16:3e:f4:71:3e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.577s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updated VIF entry in instance network info cache for port 0f3ba2b5-c398-451e-a695-7dbcaf3c3363. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updating instance_info_cache with network_info: [{"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dddb6724-2851-44bb-af1e-68cc010c5d3c req-bede4d9c-dfd5-48fe-8105-dcb191f20b31 service nova] Releasing lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:47:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:47:09 user nova-compute[75095]: INFO nova.virt.block_device [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Booting with volume snapshot 72d2b253-1f38-471b-a453-994d9e006727 at /dev/vda
Nov 15 15:47:09 user nova-compute[75095]: DEBUG nova.policy [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:47:10 user nova-compute[75095]: INFO nova.compute.manager [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] instance snapshotting
Nov 15 15:47:10 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Beginning live snapshot process
Nov 15 15:47:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:10 user nova-compute[75095]: INFO nova.compute.manager [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Terminating instance
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json -f qcow2" returned: 0 in 0.293s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Successfully created port: aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945.delta 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945.delta 1073741824" returned: 0 in 0.073s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 15:47:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-unplugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] No waiting events found dispatching network-vif-unplugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-c1b23957-11a1-4cd5-ac27-e331e716fcd1 req-7fa6cbba-7d94-45dc-9544-372e154eb4ed service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-unplugged-775042fd-5cb9-4d4a-827c-85f47018d977 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] No waiting events found dispatching network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:11 user nova-compute[75095]: WARNING nova.compute.manager [req-e652f7d4-8ec5-453e-ac92-18ebfc5b680a req-59a40975-8f12-436a-9909-fecafeb88921 service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received unexpected event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 for instance with vm_state building and task_state spawning.
Nov 15 15:47:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Port b02c9c61-0809-40d0-be33-1d8b596c67b2 binding to destination host user is already ACTIVE {{(pid=75095) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:47:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Successfully updated port: aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:47:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Instance destroyed successfully.
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.objects.instance [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lazy-loading 'resources' on Instance uuid 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:43:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1332046239',display_name='tempest-TestServerVolumeAttachmentScenario-server-1332046239',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1332046239',id=12,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEyjS2E2dXmspyMmcuiF1kVnMfHYEnn0lmf+dNIi1nOGq2tFlPpp2JK3OcoYtWTcguXTvQbeJHFZg3cwTkvRL0M3AGtCVQFCTl9xT2LwTG5yShixC6TU22vikeL089SppQ==',key_name='tempest-keypair-892964462',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70177e4d8b7343869d07d31286a352be',ramdisk_id='',reservation_id='r-7nltqcg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1980171022',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1980171022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='931607b4077a4350b0381956bd4faaa0',uuid=842fb5ef-d55d-494b-b5fe-b8f21bd02a1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converting VIF {"id": "775042fd-5cb9-4d4a-827c-85f47018d977", "address": "fa:16:3e:84:38:51", "network": {"id": "2c3cba4b-f541-4f72-b915-0611b1e28352", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-654095941-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70177e4d8b7343869d07d31286a352be", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap775042fd-5c", "ovs_interfaceid": "775042fd-5cb9-4d4a-827c-85f47018d977", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG os_vif [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap775042fd-5c, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38ac1528-8e19-4aa7-b700-78bb90c1a816) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:47:12 user nova-compute[75095]: INFO os_vif [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:38:51,bridge_name='br-int',has_traffic_filtering=True,id=775042fd-5cb9-4d4a-827c-85f47018d977,network=Network(2c3cba4b-f541-4f72-b915-0611b1e28352),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap775042fd-5c')
Nov 15 15:47:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Deleting instance files /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d_del
Nov 15 15:47:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Deletion of /opt/stack/data/nova/instances/842fb5ef-d55d-494b-b5fe-b8f21bd02a1d_del complete
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:47:12 user nova-compute[75095]: INFO nova.compute.manager [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Creating tmpfile /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/tmp33czzgap to verify with other compute node that the instance is on the same shared storage. {{(pid=75095) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] COPY block job progress, current cursor: 27328512 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Updating instance_info_cache with network_info: [{"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Instance network_info: |[{"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:47:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:47:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Instance spawned successfully.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: INFO nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Took 7.46 seconds to spawn the instance on the hypervisor.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:47:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: INFO nova.compute.manager [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Took 8.42 seconds to build instance.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2af1c513-7103-4922-8648-c4ee9f760787 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.584s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Acquiring lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] No waiting events found dispatching network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:13 user nova-compute[75095]: WARNING nova.compute.manager [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received unexpected event network-vif-plugged-775042fd-5cb9-4d4a-827c-85f47018d977 for instance with vm_state active and task_state deleting.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-changed-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Refreshing instance network info cache due to event network-changed-aef0929d-c897-472b-80de-db709cb81927. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Acquiring lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Acquired lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Refreshing network info cache for port aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:47:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance destroyed successfully.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'resources' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:45:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb02c9c61-08, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945.delta /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f82c6b03-bf10-4047-a1b0-767009bcf2d4) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:13 user nova-compute[75095]: INFO os_vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:13 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5d65e-ab80-413d-b387-6e95e8ea26cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:47:13 user nova-compute[75095]: No targets found.
Nov 15 15:47:13 user nova-compute[75095]: iSNS:
Nov 15 15:47:13 user nova-compute[75095]: No targets found.
Nov 15 15:47:13 user nova-compute[75095]: STATIC:
Nov 15 15:47:13 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:47:13 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:47:13 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:47:13 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:47:13 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:47:13 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:47:13 user nova-compute[75095]: FIRMWARE:
Nov 15 15:47:13 user nova-compute[75095]: No targets found.
Nov 15 15:47:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:47:13 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:47:13 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[861f6f68-d3f0-40af-ab93-bf32564a259b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] No waiting events found dispatching network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:13 user nova-compute[75095]: WARNING nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received unexpected event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 for instance with vm_state active and task_state None.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:13 user nova-compute[75095]: WARNING nova.compute.manager [req-89d3b43a-f576-4ff4-8c4c-b8e9d3b66180 req-6bb911aa-4ad6-40b3-8e33-b6bf099ed34a service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5dfb0b-fa94-4eb7-91dc-2922c84fcb75]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:47:13 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:47:13 user nova-compute[75095]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2eb640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[453cf706-cf45-4ba0-84ba-35d7806c1624]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6215d141-ec3f-40e7-b957-a2ff55a2eb61]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60b80e-ba22-4f2a-8363-7c418c6f75df]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feff725-0b9a-4737-8f8d-38d71210bd45]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[89055230-4424-4cb9-a6c6-49ad417ba978]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76849cff-eac1-496b-881a-ce8398a394c8]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:47:14 user nova-compute[75095]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:47:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a11716-3bc4-4212-95de-2eb11bc58ff6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Updated VIF entry in instance network info cache for port aef0929d-c897-472b-80de-db709cb81927. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Updating instance_info_cache with network_info: [{"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.476s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== disconnect_volume: return (478ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f737e016-d30b-4f81-b251-4cb89cd82468 req-e32d5c8b-e1c8-419c-bc5d-cf1ec5b38ad5 service nova] Releasing lock "refresh_cache-e60f1b14-84e3-41c4-a11a-fed0ff42202b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945.delta /opt/stack/data/nova/instances/snapshots/tmp63c81u3b/cee7e9ba8c684b15838698887728b945" returned: 0 in 0.809s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Snapshot extracted, beginning image upload
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Error from libvirt while getting description of instance-00000002: [Error Code 42] Domain not found: no domain with matching uuid '7447d0b9-3152-49ab-8576-994810c20e29' (instance-00000002): libvirt.libvirtError: Domain not found: no domain with matching uuid '7447d0b9-3152-49ab-8576-994810c20e29' (instance-00000002)
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:14 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Took 2.32 seconds to deallocate network for instance.
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.utils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6004f134-ae9e-484f-bf42-38e732da8fe7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25fab70-57e7-45a9-ac27-013c0d632be9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918ae8f-11db-4314-abd4-30a3a06e95cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc16676b-0ebc-4753-83b3-06f2777152ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:15 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb91306d-4d5d-44c0-8c97-2047c40fe6f1]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG os_brick.utils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Updating existing volume attachment record: cc1c2da5-6cc9-48cd-8551-e104efa7d914 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.791s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.393s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:47:15 user nova-compute[75095]: INFO nova.compute.claims [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Claim successful on node user
Nov 15 15:47:15 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Deleted allocations for instance 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:15 user nova-compute[75095]: WARNING nova.compute.manager [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 15:47:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-54b2deba-cd48-472b-a95e-994388c61eaf req-44343382-5a93-457c-a724-17df7f61f66b service nova] [instance: 842fb5ef-d55d-494b-b5fe-b8f21bd02a1d] Received event network-vif-deleted-775042fd-5cb9-4d4a-827c-85f47018d977 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a6b8b4a5-aeea-4ee4-94ac-bfbc90cd29a7 tempest-TestServerVolumeAttachmentScenario-1980171022 tempest-TestServerVolumeAttachmentScenario-1980171022-project-member] Lock "842fb5ef-d55d-494b-b5fe-b8f21bd02a1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.214s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:16 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '842fb5ef-d55d-494b-b5fe-b8f21bd02a1d' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '842fb5ef-d55d-494b-b5fe-b8f21bd02a1d' (instance-0000000c)
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 1.109s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'migration_context' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.objects.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Object Instance<7447d0b9-3152-49ab-8576-994810c20e29> lazy-loaded attributes: resources,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:47:17 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:17 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7413MB free_disk=24.466835021972656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.policy [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be20f91b01f48c7a4b4d271b9c05954', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04921366d7b34598b95002d0582de4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:47:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Creating image(s)
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "/opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "/opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "/opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.220s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk 1073741824" returned: 0 in 0.077s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Successfully created port: 28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 1.371s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.762s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.212s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:47:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: INFO nova.compute.manager [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Swapping old allocation on dict_keys(['7d24b3e3-8fc8-4e80-977a-b249dde4779c']) held by migration 01477937-a7af-40c0-b3c8-e73b62d22814 for instance
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Snapshot image upload complete
Nov 15 15:47:18 user nova-compute[75095]: INFO nova.compute.manager [None req-178646fa-83f5-46fc-adfe-0c1968400ca8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Took 7.90 seconds to snapshot the instance on the hypervisor.
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Overwriting current allocation {'allocations': {'7d24b3e3-8fc8-4e80-977a-b249dde4779c': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 23}}, 'project_id': '2038e0b00a9d431eaadfaac074eaee2d', 'user_id': '3f344bdd39e54736a7b7c7388bb8dbdb', 'consumer_generation': 1} on consumer 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 15:47:18 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 01477937-a7af-40c0-b3c8-e73b62d22814 has allocations against this compute host but is not found in the database.
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9c39762d-35f9-45ef-bbb3-c00bd4adce91 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ac60b17f-c938-4031-a439-e28d8563dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e60f1b14-84e3-41c4-a11a-fed0ff42202b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Cannot resize image /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Ensure instance console log exists: /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Successfully updated port: 28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquired lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-changed-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Refreshing instance network info cache due to event network-changed-28efde6b-2633-4767-9192-fb7532de25f3. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] Acquiring lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.utils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebefd32-a905-476a-9243-584919d5a0e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8d8e5e-47ee-4412-8d40-3e3ac2a2923b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c6c56-24ca-417c-8632-9ffa0ddeda04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736c72b-2752-4817-990d-e024c6ba31ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:18 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:47:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefc26cb-9cab-4928-8c7b-650bf8e20c04]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:47:18 user nova-compute[75095]: DEBUG os_brick.utils [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updating instance_info_cache with network_info: [{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Releasing lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Instance network_info: |[{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] Acquired lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Refreshing network info cache for port 28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Start _get_guest_xml network_info=[{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:47:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1909907023',display_name='tempest-ServersNegativeTestJSON-server-1909907023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1909907023',id=19,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-tyg420o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:17Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=71532b12-b122-4de2-b051-a933db8e7c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.objects.instance [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lazy-loading 'pci_devices' on Instance uuid 71532b12-b122-4de2-b051-a933db8e7c41 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:47:19 user nova-compute[75095]:   <uuid>71532b12-b122-4de2-b051-a933db8e7c41</uuid>
Nov 15 15:47:19 user nova-compute[75095]:   <name>instance-00000013</name>
Nov 15 15:47:19 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:47:19 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:47:19 user nova-compute[75095]:   <metadata>
Nov 15 15:47:19 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:47:19 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:name>tempest-ServersNegativeTestJSON-server-1909907023</nova:name>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:47:19</nova:creationTime>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:47:19 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:47:19 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:owner>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:user uuid="6be20f91b01f48c7a4b4d271b9c05954">tempest-ServersNegativeTestJSON-981531680-project-member</nova:user>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:project uuid="04921366d7b34598b95002d0582de4d6">tempest-ServersNegativeTestJSON-981531680</nova:project>
Nov 15 15:47:19 user nova-compute[75095]:       </nova:owner>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:47:19 user nova-compute[75095]:       <nova:ports>
Nov 15 15:47:19 user nova-compute[75095]:         <nova:port uuid="28efde6b-2633-4767-9192-fb7532de25f3">
Nov 15 15:47:19 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:47:19 user nova-compute[75095]:         </nova:port>
Nov 15 15:47:19 user nova-compute[75095]:       </nova:ports>
Nov 15 15:47:19 user nova-compute[75095]:     </nova:instance>
Nov 15 15:47:19 user nova-compute[75095]:   </metadata>
Nov 15 15:47:19 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:47:19 user nova-compute[75095]:     <system>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="serial">71532b12-b122-4de2-b051-a933db8e7c41</entry>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="uuid">71532b12-b122-4de2-b051-a933db8e7c41</entry>
Nov 15 15:47:19 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:47:19 user nova-compute[75095]:     </system>
Nov 15 15:47:19 user nova-compute[75095]:   </sysinfo>
Nov 15 15:47:19 user nova-compute[75095]:   <os>
Nov 15 15:47:19 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:47:19 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:47:19 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:47:19 user nova-compute[75095]:   </os>
Nov 15 15:47:19 user nova-compute[75095]:   <features>
Nov 15 15:47:19 user nova-compute[75095]:     <acpi/>
Nov 15 15:47:19 user nova-compute[75095]:     <apic/>
Nov 15 15:47:19 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:47:19 user nova-compute[75095]:   </features>
Nov 15 15:47:19 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:47:19 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:47:19 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:47:19 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:47:19 user nova-compute[75095]:   </clock>
Nov 15 15:47:19 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:47:19 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:47:19 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:47:19 user nova-compute[75095]:   </cpu>
Nov 15 15:47:19 user nova-compute[75095]:   <devices>
Nov 15 15:47:19 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:47:19 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:47:19 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk"/>
Nov 15 15:47:19 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:47:19 user nova-compute[75095]:     </disk>
Nov 15 15:47:19 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:47:19 user nova-compute[75095]:       <mac address="fa:16:3e:00:86:3e"/>
Nov 15 15:47:19 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:19 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:47:19 user nova-compute[75095]:       <target dev="tap28efde6b-26"/>
Nov 15 15:47:19 user nova-compute[75095]:     </interface>
Nov 15 15:47:19 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:47:19 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/console.log" append="off"/>
Nov 15 15:47:19 user nova-compute[75095]:     </serial>
Nov 15 15:47:19 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:47:19 user nova-compute[75095]:     <video>
Nov 15 15:47:19 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:19 user nova-compute[75095]:     </video>
Nov 15 15:47:19 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:47:19 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:47:19 user nova-compute[75095]:     </rng>
Nov 15 15:47:19 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:47:19 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:47:19 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:47:19 user nova-compute[75095]:     </memballoon>
Nov 15 15:47:19 user nova-compute[75095]:   </devices>
Nov 15 15:47:19 user nova-compute[75095]: </domain>
Nov 15 15:47:19 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1909907023',display_name='tempest-ServersNegativeTestJSON-server-1909907023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1909907023',id=19,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-tyg420o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:17Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=71532b12-b122-4de2-b051-a933db8e7c41,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG os_vif [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b75b237-891a-58b9-ac04-fb566f065a9a', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28efde6b-26, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28efde6b-26, col_values=(('qos', UUID('df56bcf0-e149-42cd-8229-93751c72eb1d')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28efde6b-26, col_values=(('external_ids', {'iface-id': '28efde6b-2633-4767-9192-fb7532de25f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:86:3e', 'vm-uuid': '71532b12-b122-4de2-b051-a933db8e7c41'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:19 user nova-compute[75095]: INFO os_vif [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26')
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] No VIF found with MAC fa:16:3e:00:86:3e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updated VIF entry in instance network info cache for port 28efde6b-2633-4767-9192-fb7532de25f3. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updating instance_info_cache with network_info: [{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fcb8e981-3330-44c6-9bdd-8a0684b4d457 req-9969871e-0337-4284-a822-f2f4a8e7f71a service nova] Releasing lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:21 user nova-compute[75095]: WARNING nova.compute.manager [req-895c3c78-04d6-4573-beff-79c7eb671e97 req-9586d727-3d09-4c92-81fe-c46cdecbb42d service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state building and task_state spawning.
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:47:21 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Creating image(s)
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Ensure instance console log exists: /opt/stack/data/nova/instances/e60f1b14-84e3-41c4-a11a-fed0ff42202b/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Start _get_guest_xml network_info=[{"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'cc1c2da5-6cc9-48cd-8551-e104efa7d914', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htkdMpTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e60f1b14-84e3-41c4-a11a-fed0ff42202b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb156cb3-50c7-47ca-bfc4-132ffb83a321', 'serial': 'bb156cb3-50c7-47ca-bfc4-132ffb83a321'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:47:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htkdMpTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:21 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:47:21 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:47:21 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:47:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bfe59c-cbb1-4ae7-8939-e8024ee88ba9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:47:21 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee9c5e4-6ed6-497b-8006-0c9e726b945f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321] added
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5971c268-cd87-40a5-bb1d-abf51a19947b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f820eb9-bce3-4f11-aded-83077e69f08e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htkdMpTm {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htkdMpTm" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69892fe-83e7-40a8-94a2-4c7badf34560]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'htkdMpTm'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2734adb2-8fe4-4e42-8258-b5d25c174b33]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4eee82-8258-4f8b-bc87-df89802a77d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980a577-0609-47f8-91ff-f05e829ba289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260]
Nov 15 15:47:21 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260] successful.
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd14c4d0-224d-490b-8e6a-c42fd0da1b21]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[560ee746-ae42-4c33-ae73-81c18047c68a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:21 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:21 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6c9a96-09aa-4418-89a8-bea8dc899dac]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:47:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htkdMpTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23236356366633962', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236356366633962', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358675589',display_name='tempest-TestVolumeBootPattern-server-1358675589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358675589',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-ouj0t8qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:10Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=e60f1b14-84e3-41c4-a11a-fed0ff42202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid e60f1b14-84e3-41c4-a11a-fed0ff42202b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:47:22 user nova-compute[75095]:   <uuid>e60f1b14-84e3-41c4-a11a-fed0ff42202b</uuid>
Nov 15 15:47:22 user nova-compute[75095]:   <name>instance-00000012</name>
Nov 15 15:47:22 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:47:22 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:47:22 user nova-compute[75095]:   <metadata>
Nov 15 15:47:22 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:47:22 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:47:22 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-server-1358675589</nova:name>
Nov 15 15:47:22 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:47:21</nova:creationTime>
Nov 15 15:47:22 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:47:22 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:47:22 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:47:22 user nova-compute[75095]:       <nova:owner>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 15:47:22 user nova-compute[75095]:       </nova:owner>
Nov 15 15:47:22 user nova-compute[75095]:       <nova:ports>
Nov 15 15:47:22 user nova-compute[75095]:         <nova:port uuid="aef0929d-c897-472b-80de-db709cb81927">
Nov 15 15:47:22 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 15:47:22 user nova-compute[75095]:         </nova:port>
Nov 15 15:47:22 user nova-compute[75095]:       </nova:ports>
Nov 15 15:47:22 user nova-compute[75095]:     </nova:instance>
Nov 15 15:47:22 user nova-compute[75095]:   </metadata>
Nov 15 15:47:22 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:47:22 user nova-compute[75095]:     <system>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="serial">e60f1b14-84e3-41c4-a11a-fed0ff42202b</entry>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="uuid">e60f1b14-84e3-41c4-a11a-fed0ff42202b</entry>
Nov 15 15:47:22 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:47:22 user nova-compute[75095]:     </system>
Nov 15 15:47:22 user nova-compute[75095]:   </sysinfo>
Nov 15 15:47:22 user nova-compute[75095]:   <os>
Nov 15 15:47:22 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:47:22 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:47:22 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:47:22 user nova-compute[75095]:   </os>
Nov 15 15:47:22 user nova-compute[75095]:   <features>
Nov 15 15:47:22 user nova-compute[75095]:     <acpi/>
Nov 15 15:47:22 user nova-compute[75095]:     <apic/>
Nov 15 15:47:22 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:47:22 user nova-compute[75095]:   </features>
Nov 15 15:47:22 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:47:22 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:47:22 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:47:22 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:47:22 user nova-compute[75095]:   </clock>
Nov 15 15:47:22 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:47:22 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:47:22 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:47:22 user nova-compute[75095]:   </cpu>
Nov 15 15:47:22 user nova-compute[75095]:   <devices>
Nov 15 15:47:22 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:47:22 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:47:22 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 15:47:22 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:47:22 user nova-compute[75095]:       <serial>bb156cb3-50c7-47ca-bfc4-132ffb83a321</serial>
Nov 15 15:47:22 user nova-compute[75095]:     </disk>
Nov 15 15:47:22 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:47:22 user nova-compute[75095]:       <mac address="fa:16:3e:f4:30:af"/>
Nov 15 15:47:22 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:22 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:47:22 user nova-compute[75095]:       <target dev="tapaef0929d-c8"/>
Nov 15 15:47:22 user nova-compute[75095]:     </interface>
Nov 15 15:47:22 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:47:22 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/e60f1b14-84e3-41c4-a11a-fed0ff42202b/console.log" append="off"/>
Nov 15 15:47:22 user nova-compute[75095]:     </serial>
Nov 15 15:47:22 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:47:22 user nova-compute[75095]:     <video>
Nov 15 15:47:22 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:22 user nova-compute[75095]:     </video>
Nov 15 15:47:22 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:47:22 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:47:22 user nova-compute[75095]:     </rng>
Nov 15 15:47:22 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:47:22 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:47:22 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:47:22 user nova-compute[75095]:     </memballoon>
Nov 15 15:47:22 user nova-compute[75095]:   </devices>
Nov 15 15:47:22 user nova-compute[75095]: </domain>
Nov 15 15:47:22 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358675589',display_name='tempest-TestVolumeBootPattern-server-1358675589',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358675589',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-ouj0t8qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:47:10Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=e60f1b14-84e3-41c4-a11a-fed0ff42202b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG os_vif [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08422ef7-ab03-55a3-af36-d7a377ce14cf', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaef0929d-c8, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaef0929d-c8, col_values=(('qos', UUID('ffcae3f4-bdb8-4412-ba64-b9620a994be9')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaef0929d-c8, col_values=(('external_ids', {'iface-id': 'aef0929d-c897-472b-80de-db709cb81927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:30:af', 'vm-uuid': 'e60f1b14-84e3-41c4-a11a-fed0ff42202b'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:22 user nova-compute[75095]: INFO os_vif [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8')
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:47:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:f4:30:af, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:23 user nova-compute[75095]: WARNING nova.compute.manager [req-f266e3fb-d4fc-48dd-b78a-d411e6cdd9ea req-a9d1a1da-bc8d-4cb3-bfdd-9a061553cdf7 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state building and task_state spawning.
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Instance spawned successfully.
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:23 user nova-compute[75095]: INFO nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Took 6.25 seconds to spawn the instance on the hypervisor.
Nov 15 15:47:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:47:23 user nova-compute[75095]: INFO nova.compute.manager [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Took 8.31 seconds to build instance.
Nov 15 15:47:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-958db334-78be-49b0-b79f-eb340817674d tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.533s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Starting finish_revert_migration {{(pid=75095) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start _get_guest_xml network_info=[{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'f037b2c1-4ddc-47b9-980c-c1a7c7924211', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '7447d0b9-3152-49ab-8576-994810c20e29', 'attached_at': '2023-11-15T15:47:24.000000', 'detached_at': '', 'volume_id': 'fa151bd9-2d9d-4dc2-b38a-86c933895386', 'serial': 'fa151bd9-2d9d-4dc2-b38a-86c933895386'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:47:24 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:24 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:24 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:47:24 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:47:24 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae34a21f-7621-4556-a644-f8183fd6274e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:47:24 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[699bb922-0e7a-44bd-8940-eaa8a50160a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386] added
Nov 15 15:47:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[600eb927-8484-4d9f-bdb0-9f23b5dc20e1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500efe3-d59e-404d-a5fe-069264124a06]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v byrQvwYn" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf439e-eb78-4221-8459-590a1506b644]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'byrQvwYn'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9005d34-9ae9-4130-b5c9-73c811cfeb58]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d24b966-7eae-45cc-901a-1883f10b7cc3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:24 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:24 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] No waiting events found dispatching network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:24 user nova-compute[75095]: WARNING nova.compute.manager [req-84225c49-af5d-4015-993e-1d44402c11d5 req-bc9df8ae-3917-4179-9a85-2e6db26c8015 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received unexpected event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 for instance with vm_state building and task_state spawning.
Nov 15 15:47:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --login" returned: 0 in 1.084s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f25a004-00e7-40b6-8ee7-45b3aa8a19f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:47:25 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:47:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6dbdf-636e-4e7b-b5a2-8566092ef2bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6025aee1-86fc-45f6-81af-a040392163e9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:25 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:25 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:47:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:47:25 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:47:25 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:47:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.386s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe732a6-f353-4f31-86cf-20892b9c4074]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:47:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:47:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Instance spawned successfully.
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] No waiting events found dispatching network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:26 user nova-compute[75095]: WARNING nova.compute.manager [req-5d0ac160-2e28-4911-978d-b79ea7336723 req-871ce9c8-c370-4201-aa03-04406d563439 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received unexpected event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 for instance with vm_state building and task_state spawning.
Nov 15 15:47:26 user nova-compute[75095]: INFO nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.417s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== connect_volume: return (2419ms) {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661306338373739', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:47:26 user nova-compute[75095]:   <uuid>7447d0b9-3152-49ab-8576-994810c20e29</uuid>
Nov 15 15:47:26 user nova-compute[75095]:   <name>instance-00000002</name>
Nov 15 15:47:26 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:47:26 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:47:26 user nova-compute[75095]:   <metadata>
Nov 15 15:47:26 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:47:26 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherB-server-67125786</nova:name>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:47:24</nova:creationTime>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:47:26 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:47:26 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:owner>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:user uuid="3f344bdd39e54736a7b7c7388bb8dbdb">tempest-ServerActionsTestOtherB-1639554019-project-member</nova:user>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:project uuid="2038e0b00a9d431eaadfaac074eaee2d">tempest-ServerActionsTestOtherB-1639554019</nova:project>
Nov 15 15:47:26 user nova-compute[75095]:       </nova:owner>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:47:26 user nova-compute[75095]:       <nova:ports>
Nov 15 15:47:26 user nova-compute[75095]:         <nova:port uuid="b02c9c61-0809-40d0-be33-1d8b596c67b2">
Nov 15 15:47:26 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:47:26 user nova-compute[75095]:         </nova:port>
Nov 15 15:47:26 user nova-compute[75095]:       </nova:ports>
Nov 15 15:47:26 user nova-compute[75095]:     </nova:instance>
Nov 15 15:47:26 user nova-compute[75095]:   </metadata>
Nov 15 15:47:26 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:47:26 user nova-compute[75095]:     <system>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="serial">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="uuid">7447d0b9-3152-49ab-8576-994810c20e29</entry>
Nov 15 15:47:26 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:47:26 user nova-compute[75095]:     </system>
Nov 15 15:47:26 user nova-compute[75095]:   </sysinfo>
Nov 15 15:47:26 user nova-compute[75095]:   <os>
Nov 15 15:47:26 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:47:26 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:47:26 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:47:26 user nova-compute[75095]:   </os>
Nov 15 15:47:26 user nova-compute[75095]:   <features>
Nov 15 15:47:26 user nova-compute[75095]:     <acpi/>
Nov 15 15:47:26 user nova-compute[75095]:     <apic/>
Nov 15 15:47:26 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:47:26 user nova-compute[75095]:   </features>
Nov 15 15:47:26 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:47:26 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:47:26 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:47:26 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:47:26 user nova-compute[75095]:   </clock>
Nov 15 15:47:26 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:47:26 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:47:26 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:47:26 user nova-compute[75095]:   </cpu>
Nov 15 15:47:26 user nova-compute[75095]:   <devices>
Nov 15 15:47:26 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:47:26 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:47:26 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk"/>
Nov 15 15:47:26 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:47:26 user nova-compute[75095]:     </disk>
Nov 15 15:47:26 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:47:26 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:47:26 user nova-compute[75095]:       <source dev="/dev/sdd"/>
Nov 15 15:47:26 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:47:26 user nova-compute[75095]:       <serial>fa151bd9-2d9d-4dc2-b38a-86c933895386</serial>
Nov 15 15:47:26 user nova-compute[75095]:     </disk>
Nov 15 15:47:26 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:47:26 user nova-compute[75095]:       <mac address="fa:16:3e:56:ec:23"/>
Nov 15 15:47:26 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:26 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:47:26 user nova-compute[75095]:       <target dev="tapb02c9c61-08"/>
Nov 15 15:47:26 user nova-compute[75095]:     </interface>
Nov 15 15:47:26 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:47:26 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/console.log" append="off"/>
Nov 15 15:47:26 user nova-compute[75095]:     </serial>
Nov 15 15:47:26 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:47:26 user nova-compute[75095]:     <video>
Nov 15 15:47:26 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:47:26 user nova-compute[75095]:     </video>
Nov 15 15:47:26 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:47:26 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:47:26 user nova-compute[75095]:     </rng>
Nov 15 15:47:26 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:47:26 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:47:26 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:47:26 user nova-compute[75095]:     </memballoon>
Nov 15 15:47:26 user nova-compute[75095]:   </devices>
Nov 15 15:47:26 user nova-compute[75095]: </domain>
Nov 15 15:47:26 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG os_vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12b4c361-3a4f-5a90-9f69-e06add412966', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb02c9c61-08, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb02c9c61-08, col_values=(('qos', UUID('d9a314c1-f05e-45ea-aa29-e6379c14eab6')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb02c9c61-08, col_values=(('external_ids', {'iface-id': 'b02c9c61-0809-40d0-be33-1d8b596c67b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ec:23', 'vm-uuid': '7447d0b9-3152-49ab-8576-994810c20e29'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:26 user nova-compute[75095]: INFO os_vif [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:47:26 user nova-compute[75095]: INFO nova.compute.manager [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Took 18.15 seconds to build instance.
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7f5680be-9104-4878-ba35-5ac4298cfef5 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.373s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:27 user nova-compute[75095]: INFO nova.compute.manager [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Terminating instance
Nov 15 15:47:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Instance destroyed successfully.
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lazy-loading 'resources' on Instance uuid 9c39762d-35f9-45ef-bbb3-c00bd4adce91 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-85380442',display_name='tempest-VolumesActionsTest-instance-85380442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-85380442',id=14,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fcf1dcb392a4ec2b16fb1eb42cf3185',ramdisk_id='',reservation_id='r-v0uvor9q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-962818578',owner_user_name='tempest-VolumesActionsTest-962818578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:45:43Z,user_data=None,user_id='c6594c4639944887bb9f9f3b9e6f4f67',uuid=9c39762d-35f9-45ef-bbb3-c00bd4adce91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converting VIF {"id": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "address": "fa:16:3e:fc:7c:ff", "network": {"id": "8cbd3d26-e095-477b-8bec-ccc29bff6f33", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1514339205-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fcf1dcb392a4ec2b16fb1eb42cf3185", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa041c0dd-ff", "ovs_interfaceid": "a041c0dd-ffb7-4dab-abb1-725b74c1892f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG os_vif [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa041c0dd-ff, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a27fa65-1e1a-4f62-9d54-03cb199436d5) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: INFO os_vif [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7c:ff,bridge_name='br-int',has_traffic_filtering=True,id=a041c0dd-ffb7-4dab-abb1-725b74c1892f,network=Network(8cbd3d26-e095-477b-8bec-ccc29bff6f33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa041c0dd-ff')
Nov 15 15:47:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Deleting instance files /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91_del
Nov 15 15:47:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Deletion of /opt/stack/data/nova/instances/9c39762d-35f9-45ef-bbb3-c00bd4adce91_del complete
Nov 15 15:47:28 user nova-compute[75095]: INFO nova.compute.manager [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 15:47:28 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:28 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-unplugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] No waiting events found dispatching network-vif-unplugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-unplugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Acquiring lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] No waiting events found dispatching network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:29 user nova-compute[75095]: WARNING nova.compute.manager [req-a696052a-6818-491f-be16-4a6d32172e11 req-fe4a205a-0f17-48c6-af27-d0232575fa0f service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received unexpected event network-vif-plugged-a041c0dd-ffb7-4dab-abb1-725b74c1892f for instance with vm_state active and task_state deleting.
Nov 15 15:47:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:29 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Took 0.88 seconds to deallocate network for instance.
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.567s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:29 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Deleted allocations for instance 9c39762d-35f9-45ef-bbb3-c00bd4adce91
Nov 15 15:47:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e3d4a9f8-5a46-439e-83a3-8bf43cb0917d tempest-VolumesActionsTest-962818578 tempest-VolumesActionsTest-962818578-project-member] Lock "9c39762d-35f9-45ef-bbb3-c00bd4adce91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.865s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 9c39762d-35f9-45ef-bbb3-c00bd4adce91] Received event network-vif-deleted-a041c0dd-ffb7-4dab-abb1-725b74c1892f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:31 user nova-compute[75095]: WARNING nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:47:31 user nova-compute[75095]: WARNING nova.compute.manager [req-0b387a5a-2a22-4e80-9180-c4f6074efd82 req-7f75fa33-fd48-4e2f-adee-bbd45e088d82 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:47:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance running successfully.
Nov 15 15:47:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] finish_revert_migration finished successfully. {{(pid=75095) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 15:47:31 user nova-compute[75095]: INFO nova.compute.manager [None req-ceb7a0db-9eda-46fd-aad7-e9f4c3539527 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance to original state: 'active'
Nov 15 15:47:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-changed-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Refreshing instance network info cache due to event network-changed-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] Acquiring lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] Acquired lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Refreshing network info cache for port 6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updated VIF entry in instance network info cache for port 6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:47:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating instance_info_cache with network_info: [{"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29ccd3df-a5a5-4d37-81b5-893868d7596c req-e907599a-e1b2-4e38-8f3c-1fe5a7a5e597 service nova] Releasing lock "refresh_cache-497c558c-8e03-4dd5-ab88-8df09337e0fa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'flavor' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:55 user nova-compute[75095]: INFO nova.compute.manager [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attaching volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272 to /dev/vdb
Nov 15 15:47:55 user nova-compute[75095]: DEBUG os_brick.utils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d6ac01-af3e-4dcd-a7b2-2f0e39fbc83d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899da5d-d7d7-42e2-b4ae-0bebf433e0a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[932be7ba-196e-443d-89e5-6b64206b0fee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[41976366-3752-48c5-8578-fae913492f9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:56 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:47:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84f937-8dd9-460c-bcb8-28b6bf528950]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating existing volume attachment record: 5231e031-947a-4873-9018-ef35b06445df {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:47:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing instance network info cache due to event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] Acquiring lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] Acquired lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:47:57 user nova-compute[75095]: INFO nova.compute.manager [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Attaching volume 6c740a55-bcef-4bbb-92e4-a18185b14253 to /dev/vdb
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.utils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[36877316-867f-4701-813a-ea01f9ab61bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4913be82-2fc3-4a7a-8a4c-f5811129bfd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2f1b1d-8348-4f07-8399-0b20ea486fd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a170eb-a0ba-43ed-874a-11a9d38203a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:47:57 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:47:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0f6a6c-b552-4cea-868d-034771de4c34]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG os_brick.utils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:47:57 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating existing volume attachment record: 5ab2ff97-cc31-4c99-9299-310c82f0a504 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:47:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:47:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updated VIF entry in instance network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:47:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating instance_info_cache with network_info: [{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:47:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dbd5b75-e46b-4c07-ac67-0d15a44b321a req-b7d69d81-d155-4d6b-936e-c3f4364a2f25 service nova] Releasing lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:47:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:02 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:02 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:02 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[218feaa2-d3b2-49d3-9bd6-c500ad7990fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:48:02 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0ef65d-2aa6-4c22-8104-14ba754ca1af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272] added
Nov 15 15:48:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2312e596-b95c-40d2-a989-863be384e41a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e2dc57-6a84-495a-b9b8-b19ab0d6779e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIqbUoeL {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIqbUoeL" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca93e846-daac-45ce-820a-92ffd134af3f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIqbUoeL'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6dc53-68b7-41f0-a733-31575c804491]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1597be-5729-4ebc-bb8e-2890f1139886]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:02 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:02 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:02 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:02 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --login" returned: 0 in 0.195s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f7e1c9-dde7-49db-810d-63a31858d22d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]
Nov 15 15:48:03 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae4567-190e-4994-9b1c-c0ac39a6dbe9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d3721-74fb-41b6-8998-16df6b4dab51]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOZfQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:03 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a228d3cb-2f98-4b73-a704-c2d06c9ee26b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23937396634383133', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937396634383133', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.018s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:04 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'flavor' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7529efd6-c543-4e33-84d1-28dc7b4f6f68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:48:04 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:48:04 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:04 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 15:48:04 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:04 user nova-compute[75095]:   <serial>8365b8c1-c8d4-42ee-9eef-91da5d46c272</serial>
Nov 15 15:48:04 user nova-compute[75095]: </disk>
Nov 15 15:48:04 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516d62f-273a-4227-8f21-6d8a673400e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253] added
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[942d0cf2-f2c9-4267-bb5d-f45d75229591]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79b3ea7-2a3b-4297-8996-adb7b313f133]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrOZfQyp {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrOZfQyp" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1dc0d4-82fb-4a6c-8412-cf9a97dcc614]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrOZfQyp'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e1676a-a70f-46ba-a0a6-a042ae313847]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b299fd10-e9ac-4af4-bccf-d99444fbf5c0]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2dc900-ea3e-432d-817e-173deff4a35b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260]
Nov 15 15:48:04 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd13efdb-1c33-414c-8458-76d784512058]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1bf784-710a-44df-ad41-3e143a4b7b3c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ea12f4-f599-4004-9905-079e51a28d81]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOZfQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:5e:cc:2c, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 15:48:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1076d4d4-ebd5-4df1-b5ea-22d0fa749fed tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.034s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== connect_volume: return (2391ms) {'type': 'block', 'scsi_wwn': '26539663063393561', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539663063393561', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:48:05 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:05 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:48:05 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:05 user nova-compute[75095]:   <serial>6c740a55-bcef-4bbb-92e4-a18185b14253</serial>
Nov 15 15:48:05 user nova-compute[75095]: </disk>
Nov 15 15:48:05 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] No VIF found with MAC fa:16:3e:54:85:c0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1d5f49f7-0079-4141-9b30-cbf7e25d7c11 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.341s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:06 user nova-compute[75095]: INFO nova.compute.manager [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Rebuilding instance
Nov 15 15:48:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:06 user nova-compute[75095]: INFO nova.compute.manager [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Unrescuing
Nov 15 15:48:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance destroyed successfully.
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'flavor' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.compute.manager [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Detaching volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.virt.block_device [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attempting to driver detach volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272 from mountpoint /dev/vdb
Nov 15 15:48:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Attempting to detach device vdb from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:48:07 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:07 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 15:48:07 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:07 user nova-compute[75095]:   <serial>8365b8c1-c8d4-42ee-9eef-91da5d46c272</serial>
Nov 15 15:48:07 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:48:07 user nova-compute[75095]: </disk>
Nov 15 15:48:07 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully detached device vdb from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the persistent domain config.
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:07 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8092f761-226b-42a7-9845-b58c6702cce6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:48:07 user nova-compute[75095]: No targets found.
Nov 15 15:48:07 user nova-compute[75095]: iSNS:
Nov 15 15:48:07 user nova-compute[75095]: No targets found.
Nov 15 15:48:07 user nova-compute[75095]: STATIC:
Nov 15 15:48:07 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321
Nov 15 15:48:07 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:07 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:07 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:48:07 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:07 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:07 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:48:07 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:07 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:07 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:48:07 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:07 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:07 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253
Nov 15 15:48:07 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:07 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:07 user nova-compute[75095]: FIRMWARE:
Nov 15 15:48:07 user nova-compute[75095]: No targets found.
Nov 15 15:48:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:48:07 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:48:07 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a450fa-256f-477c-8387-45b95be59bc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b4309-da86-41c7-9bc8-2e2a80f4fa9a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a05c20-b20a-4ad3-982d-8599ce2dc385]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f924758-53fe-458f-a350-501c6df3611c]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[656e694d-d258-4756-bb67-fddd8beac796]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.compute.manager [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Detaching volume 6c740a55-bcef-4bbb-92e4-a18185b14253
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f611050d-a034-41df-a268-fc5f58587acb]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.compute.claims [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Claim successful on node user
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c533166-f170-4497-9e53-f459ae76697c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.virt.block_device [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Attempting to driver detach volume 6c740a55-bcef-4bbb-92e4-a18185b14253 from mountpoint /dev/vdb
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Attempting to detach device vdb from instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:48:07 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:07 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:48:07 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:07 user nova-compute[75095]:   <serial>6c740a55-bcef-4bbb-92e4-a18185b14253</serial>
Nov 15 15:48:07 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:48:07 user nova-compute[75095]: </disk>
Nov 15 15:48:07 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:48:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully detached device vdb from instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 from the persistent domain config.
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:48:07 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:07 user nova-compute[75095]:   <source dev="/dev/sdf"/>
Nov 15 15:48:07 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:07 user nova-compute[75095]:   <serial>6c740a55-bcef-4bbb-92e4-a18185b14253</serial>
Nov 15 15:48:07 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:48:07 user nova-compute[75095]: </disk>
Nov 15 15:48:07 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6dfd41-92f5-48ff-a2bb-beb6fbdaf357]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]
Nov 15 15:48:07 user nova-compute[75095]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[982ab47f-5cc4-4250-899d-138ac3c4e511]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== disconnect_volume: return (363ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:07 user nova-compute[75095]: WARNING nova.compute.manager [req-3f90a246-8d90-470f-9ed7-9834d3cee241 req-bf876fd0-bf99-48e7-b32c-ed1641e5f9c3 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.policy [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc038f8167534a84b3eaf5f51a0b48b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76802ebc10124616875959183e7cf3ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:48:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance destroyed successfully.
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:48:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Creating image(s)
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "/opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "/opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "/opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance destroyed successfully.
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-ServerActionsTestOtherA-server-926662284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a39a1cd-8a, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64756284-bf69-4b2a-bce7-8dbd95a55497) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:08 user nova-compute[75095]: INFO os_vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a')
Nov 15 15:48:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2173b-63eb-4da7-bc12-561aa4f073c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:48:08 user nova-compute[75095]: No targets found.
Nov 15 15:48:08 user nova-compute[75095]: iSNS:
Nov 15 15:48:08 user nova-compute[75095]: No targets found.
Nov 15 15:48:08 user nova-compute[75095]: STATIC:
Nov 15 15:48:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321
Nov 15 15:48:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:48:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:48:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253
Nov 15 15:48:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:08 user nova-compute[75095]: FIRMWARE:
Nov 15 15:48:08 user nova-compute[75095]: No targets found.
Nov 15 15:48:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:48:08 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:48:08 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk 1073741824" returned: 0 in 0.061s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0297fa8-819e-4dcf-9818-fd926d7ed629]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f82e4d-79e6-4fae-8d6c-102f51977042]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e7f40>, {}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Disconnecting from: [] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.146s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== disconnect_volume: return (148ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:48:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Deleting instance files /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa_del
Nov 15 15:48:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Deletion of /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa_del complete
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:09 user nova-compute[75095]: WARNING nova.compute.manager [req-37e232b2-7e85-42a6-a3d8-87980cf609d6 req-ab09d22c-38bb-41ed-a481-5f5c03aa491f service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state active and task_state rebuilding.
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: INFO nova.virt.block_device [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Booting with volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272 at /dev/vdb
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.utils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80dd21-bfa6-4cf8-9a5b-4799e34ec164]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e396ed-0142-46ac-87ef-b571e1ed9423]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a17be7-328f-494a-8985-21d74e8e53bb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52a182-d701-4fdf-96a3-cec62fb60d6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Cannot resize image /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Ensure instance console log exists: /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:09 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4892bbf9-5fbe-4451-83e1-5a10c6a08cd4]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG os_brick.utils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating existing volume attachment record: 8de922ab-fa17-4514-a753-49075363522e {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Successfully created port: f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:09 user nova-compute[75095]: WARNING nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing instance network info cache due to event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Successfully updated port: f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquired lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updating instance_info_cache with network_info: [{"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Releasing lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Instance network_info: |[{"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Start _get_guest_xml network_info=[{"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:48:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1335325',id=20,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSUm9QUrUExrfs4v/ePz1RlaY2ujy6QsGK6t6/qDDPJS+fYUukbGt3AFQWfpTKn1M9Z224xvr3eZ8SvDuZkUle6djqtyVVgYEAAZlaOStZ7Yh7cBbaLYFztoWZynPty7g==',key_name='tempest-keypair-374616655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76802ebc10124616875959183e7cf3ab',ramdisk_id='',reservation_id='r-tvgq4p9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc038f8167534a84b3eaf5f51a0b48b4',uuid=b88184a5-9c2d-4005-a46a-f595b7be5efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converting VIF {"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lazy-loading 'pci_devices' on Instance uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:48:10 user nova-compute[75095]:   <uuid>b88184a5-9c2d-4005-a46a-f595b7be5efe</uuid>
Nov 15 15:48:10 user nova-compute[75095]:   <name>instance-00000014</name>
Nov 15 15:48:10 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:48:10 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:48:10 user nova-compute[75095]:   <metadata>
Nov 15 15:48:10 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:48:10 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889</nova:name>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:48:10</nova:creationTime>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:48:10 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:48:10 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:owner>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:user uuid="dc038f8167534a84b3eaf5f51a0b48b4">tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member</nova:user>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:project uuid="76802ebc10124616875959183e7cf3ab">tempest-TestServerVolumeAttachScenarioOldVersion-935440045</nova:project>
Nov 15 15:48:10 user nova-compute[75095]:       </nova:owner>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:48:10 user nova-compute[75095]:       <nova:ports>
Nov 15 15:48:10 user nova-compute[75095]:         <nova:port uuid="f1bebef6-c544-45fe-bf9e-63dbca401df1">
Nov 15 15:48:10 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 15:48:10 user nova-compute[75095]:         </nova:port>
Nov 15 15:48:10 user nova-compute[75095]:       </nova:ports>
Nov 15 15:48:10 user nova-compute[75095]:     </nova:instance>
Nov 15 15:48:10 user nova-compute[75095]:   </metadata>
Nov 15 15:48:10 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:48:10 user nova-compute[75095]:     <system>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="serial">b88184a5-9c2d-4005-a46a-f595b7be5efe</entry>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="uuid">b88184a5-9c2d-4005-a46a-f595b7be5efe</entry>
Nov 15 15:48:10 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:48:10 user nova-compute[75095]:     </system>
Nov 15 15:48:10 user nova-compute[75095]:   </sysinfo>
Nov 15 15:48:10 user nova-compute[75095]:   <os>
Nov 15 15:48:10 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:48:10 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:48:10 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:48:10 user nova-compute[75095]:   </os>
Nov 15 15:48:10 user nova-compute[75095]:   <features>
Nov 15 15:48:10 user nova-compute[75095]:     <acpi/>
Nov 15 15:48:10 user nova-compute[75095]:     <apic/>
Nov 15 15:48:10 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:48:10 user nova-compute[75095]:   </features>
Nov 15 15:48:10 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:48:10 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:48:10 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:48:10 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:48:10 user nova-compute[75095]:   </clock>
Nov 15 15:48:10 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:48:10 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:48:10 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:48:10 user nova-compute[75095]:   </cpu>
Nov 15 15:48:10 user nova-compute[75095]:   <devices>
Nov 15 15:48:10 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:48:10 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:48:10 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk"/>
Nov 15 15:48:10 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:48:10 user nova-compute[75095]:     </disk>
Nov 15 15:48:10 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:48:10 user nova-compute[75095]:       <mac address="fa:16:3e:a0:f7:dc"/>
Nov 15 15:48:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:10 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:48:10 user nova-compute[75095]:       <target dev="tapf1bebef6-c5"/>
Nov 15 15:48:10 user nova-compute[75095]:     </interface>
Nov 15 15:48:10 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:48:10 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/console.log" append="off"/>
Nov 15 15:48:10 user nova-compute[75095]:     </serial>
Nov 15 15:48:10 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:48:10 user nova-compute[75095]:     <video>
Nov 15 15:48:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:10 user nova-compute[75095]:     </video>
Nov 15 15:48:10 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:48:10 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:48:10 user nova-compute[75095]:     </rng>
Nov 15 15:48:10 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:48:10 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:48:10 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:48:10 user nova-compute[75095]:     </memballoon>
Nov 15 15:48:10 user nova-compute[75095]:   </devices>
Nov 15 15:48:10 user nova-compute[75095]: </domain>
Nov 15 15:48:10 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1335325',id=20,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSUm9QUrUExrfs4v/ePz1RlaY2ujy6QsGK6t6/qDDPJS+fYUukbGt3AFQWfpTKn1M9Z224xvr3eZ8SvDuZkUle6djqtyVVgYEAAZlaOStZ7Yh7cBbaLYFztoWZynPty7g==',key_name='tempest-keypair-374616655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76802ebc10124616875959183e7cf3ab',ramdisk_id='',reservation_id='r-tvgq4p9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc038f8167534a84b3eaf5f51a0b48b4',uuid=b88184a5-9c2d-4005-a46a-f595b7be5efe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converting VIF {"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG os_vif [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0b079f6-39e3-52bc-98c1-8a0eabc90d99', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1bebef6-c5, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1bebef6-c5, col_values=(('qos', UUID('bc031f79-1435-4814-b5dd-242c4feb9e5a')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1bebef6-c5, col_values=(('external_ids', {'iface-id': 'f1bebef6-c544-45fe-bf9e-63dbca401df1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:f7:dc', 'vm-uuid': 'b88184a5-9c2d-4005-a46a-f595b7be5efe'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:10 user nova-compute[75095]: INFO os_vif [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5')
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] No VIF found with MAC fa:16:3e:a0:f7:dc, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updated VIF entry in instance network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing instance network info cache due to event network-changed-b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Acquiring lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Acquired lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Refreshing network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:11 user nova-compute[75095]: WARNING nova.compute.manager [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-changed-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Refreshing instance network info cache due to event network-changed-f1bebef6-c544-45fe-bf9e-63dbca401df1. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Acquiring lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Acquired lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.network.neutron [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Refreshing network info cache for port f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [{"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-7447d0b9-3152-49ab-8576-994810c20e29" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:12 user nova-compute[75095]: WARNING nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:12 user nova-compute[75095]: WARNING nova.compute.manager [req-6a011065-4d73-4556-8b84-a2a1624c6168 req-1fc09123-dfab-4643-a896-6fe3ce2b1599 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-44ca1fba-3581-4df1-9d11-9eed79d8a2d4 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updated VIF entry in instance network info cache for port b8c2c859-3325-4d81-a66f-fb84a4115cfd. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [{"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updated VIF entry in instance network info cache for port f1bebef6-c544-45fe-bf9e-63dbca401df1. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updating instance_info_cache with network_info: [{"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e5f76bb-743a-4c89-a7b2-1b83039589c2 req-cb4ff5ce-0848-4925-853a-c582e858644a service nova] Releasing lock "refresh_cache-f8acca60-e3f3-412e-bf0f-023ed2943bfc" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9de3a51d-0b53-4a08-9aa6-dabf55e51118 req-b77f8378-5fe7-44cd-b353-5d7e28e3fc78 service nova] Releasing lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] No waiting events found dispatching network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:13 user nova-compute[75095]: WARNING nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received unexpected event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 for instance with vm_state building and task_state spawning.
Nov 15 15:48:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] No waiting events found dispatching network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:13 user nova-compute[75095]: WARNING nova.compute.manager [req-8254d3dd-5d9a-4944-b83d-5d36a2ca0c43 req-7459a8b8-713f-4dd9-9e22-dfd1b4b7c5b2 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received unexpected event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 for instance with vm_state building and task_state spawning.
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:48:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Instance spawned successfully.
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:14 user nova-compute[75095]: INFO nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 15 15:48:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:48:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Creating image(s)
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: INFO nova.compute.manager [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Took 7.37 seconds to build instance.
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6666b1b8-e734-4047-93e3-23e92166f40b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.518s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.210s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk 1073741824" returned: 0 in 0.081s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Cannot resize image /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Ensure instance console log exists: /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start _get_guest_xml network_info=[{"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '8de922ab-fa17-4514-a753-49075363522e', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '497c558c-8e03-4dd5-ab88-8df09337e0fa', 'attached_at': '', 'detached_at': '', 'volume_id': '8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'serial': '8365b8c1-c8d4-42ee-9eef-91da5d46c272'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:48:15 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 15:48:15 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.objects.instance [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'vcpu_model' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:15 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:48:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:15 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 15:48:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:15 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d4bf69-a148-49c6-bf73-488acb2a72e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:48:16 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa4214-ed81-41b8-8204-001774cddb3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272] added
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[113fb71c-c5e1-4f7e-9ff0-cc6f8d22f692]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eee437-4ff2-4ca0-b64f-4d058bc8896c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIqbUoeL {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jIqbUoeL" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[20911068-914a-44ef-8731-51de5315ea37]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jIqbUoeL'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6487981a-5758-4d5a-892a-a53b1237e4eb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5a3910-84d1-4475-bd75-d9f5ddeab4d2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49397f11-2f63-46dd-a4e8-777cb6cd18c4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]
Nov 15 15:48:16 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af7ce4e-e96a-4938-8395-1737fc0ae10c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd909c06-77f9-478d-ab7c-ec5176a412f8]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f88928-06f9-4c1e-8314-526668fa4c0b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:17 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:17 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7321MB free_disk=24.439258575439453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23937396634383133', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937396634383133', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-ServerActionsTestOtherA-server-926662284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:48:17 user nova-compute[75095]:   <uuid>497c558c-8e03-4dd5-ab88-8df09337e0fa</uuid>
Nov 15 15:48:17 user nova-compute[75095]:   <name>instance-0000000f</name>
Nov 15 15:48:17 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:48:17 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:48:17 user nova-compute[75095]:   <metadata>
Nov 15 15:48:17 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:48:17 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherA-server-926662284</nova:name>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:48:15</nova:creationTime>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:48:17 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:48:17 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:owner>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:user uuid="975ca4994eb74b6bbf541bb308b148f1">tempest-ServerActionsTestOtherA-440053215-project-member</nova:user>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:project uuid="18c587b1467441ceb091ece4e973408e">tempest-ServerActionsTestOtherA-440053215</nova:project>
Nov 15 15:48:17 user nova-compute[75095]:       </nova:owner>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:48:17 user nova-compute[75095]:       <nova:ports>
Nov 15 15:48:17 user nova-compute[75095]:         <nova:port uuid="6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6">
Nov 15 15:48:17 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:48:17 user nova-compute[75095]:         </nova:port>
Nov 15 15:48:17 user nova-compute[75095]:       </nova:ports>
Nov 15 15:48:17 user nova-compute[75095]:     </nova:instance>
Nov 15 15:48:17 user nova-compute[75095]:   </metadata>
Nov 15 15:48:17 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:48:17 user nova-compute[75095]:     <system>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="serial">497c558c-8e03-4dd5-ab88-8df09337e0fa</entry>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="uuid">497c558c-8e03-4dd5-ab88-8df09337e0fa</entry>
Nov 15 15:48:17 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:48:17 user nova-compute[75095]:     </system>
Nov 15 15:48:17 user nova-compute[75095]:   </sysinfo>
Nov 15 15:48:17 user nova-compute[75095]:   <os>
Nov 15 15:48:17 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:48:17 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:48:17 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:48:17 user nova-compute[75095]:   </os>
Nov 15 15:48:17 user nova-compute[75095]:   <features>
Nov 15 15:48:17 user nova-compute[75095]:     <acpi/>
Nov 15 15:48:17 user nova-compute[75095]:     <apic/>
Nov 15 15:48:17 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:48:17 user nova-compute[75095]:   </features>
Nov 15 15:48:17 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:48:17 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:48:17 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:48:17 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:48:17 user nova-compute[75095]:   </clock>
Nov 15 15:48:17 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:48:17 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:48:17 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:48:17 user nova-compute[75095]:   </cpu>
Nov 15 15:48:17 user nova-compute[75095]:   <devices>
Nov 15 15:48:17 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:48:17 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:48:17 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk"/>
Nov 15 15:48:17 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:48:17 user nova-compute[75095]:     </disk>
Nov 15 15:48:17 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:48:17 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:17 user nova-compute[75095]:       <source dev="/dev/sde"/>
Nov 15 15:48:17 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:48:17 user nova-compute[75095]:       <serial>8365b8c1-c8d4-42ee-9eef-91da5d46c272</serial>
Nov 15 15:48:17 user nova-compute[75095]:     </disk>
Nov 15 15:48:17 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:48:17 user nova-compute[75095]:       <mac address="fa:16:3e:5e:cc:2c"/>
Nov 15 15:48:17 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:17 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:48:17 user nova-compute[75095]:       <target dev="tap6a39a1cd-8a"/>
Nov 15 15:48:17 user nova-compute[75095]:     </interface>
Nov 15 15:48:17 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:48:17 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/console.log" append="off"/>
Nov 15 15:48:17 user nova-compute[75095]:     </serial>
Nov 15 15:48:17 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:48:17 user nova-compute[75095]:     <video>
Nov 15 15:48:17 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:17 user nova-compute[75095]:     </video>
Nov 15 15:48:17 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:48:17 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:48:17 user nova-compute[75095]:     </rng>
Nov 15 15:48:17 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:48:17 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:48:17 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:48:17 user nova-compute[75095]:     </memballoon>
Nov 15 15:48:17 user nova-compute[75095]:   </devices>
Nov 15 15:48:17 user nova-compute[75095]: </domain>
Nov 15 15:48:17 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-ServerActionsTestOtherA-server-926662284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG os_vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddc715ec-7abd-5f68-b00d-7a3821933526', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a39a1cd-8a, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a39a1cd-8a, col_values=(('qos', UUID('3911f509-2531-4863-8618-fba19310d0d2')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a39a1cd-8a, col_values=(('external_ids', {'iface-id': '6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:cc:2c', 'vm-uuid': '497c558c-8e03-4dd5-ab88-8df09337e0fa'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:17 user nova-compute[75095]: INFO os_vif [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a')
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:5e:cc:2c, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ac60b17f-c938-4031-a439-e28d8563dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e60f1b14-84e3-41c4-a11a-fed0ff42202b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b88184a5-9c2d-4005-a46a-f595b7be5efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 15:48:17 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.929s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:19 user nova-compute[75095]: WARNING nova.compute.manager [req-d7100a9c-47b8-47b5-9ddc-b4b16ba558c2 req-ff03c2b6-096f-4fc5-84a9-02d474dd3c37 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 15:48:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:48:20 user nova-compute[75095]: INFO nova.compute.claims [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Claim successful on node user
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:48:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:48:20 user nova-compute[75095]: DEBUG nova.policy [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e464dcfa23814b2798c8738730374dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146bfea92e9f4bf3b6996aac094f9e43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:48:21 user nova-compute[75095]: INFO nova.virt.block_device [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Booting with blank volume at /dev/vda
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:21 user nova-compute[75095]: WARNING nova.compute.manager [req-bb786625-7475-42d7-b571-5eced89d7183 req-1c5fdb74-6847-48b6-9da7-39a0978bab75 service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:48:21 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance spawned successfully.
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75095) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b1a7a9c3-fdad-4bf4-aca2-4b6e5bff8121 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.117s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Successfully created port: d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Successfully updated port: d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:48:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance network_info: |[{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-changed-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Refreshing instance network info cache due to event network-changed-d2faa453-bbaa-47be-b0ed-78821863719b. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Refreshing network info cache for port d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updated VIF entry in instance network info cache for port d2faa453-bbaa-47be-b0ed-78821863719b. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f498e6c9-e442-4f0b-b58e-71bca868d714 req-09d7442f-62dc-45e9-8e6f-51379abc70b5 service nova] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:23 user nova-compute[75095]: WARNING nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 8590b8bb-61ea-4e65-826e-c8e0caf4620e {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid e60f1b14-84e3-41c4-a11a-fed0ff42202b {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 71532b12-b122-4de2-b051-a933db8e7c41 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "7447d0b9-3152-49ab-8576-994810c20e29" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "71532b12-b122-4de2-b051-a933db8e7c41" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "7447d0b9-3152-49ab-8576-994810c20e29" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "71532b12-b122-4de2-b051-a933db8e7c41" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.utils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f1a2cb-1227-41ee-a47f-3aa44e0d92cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb7e97d-71f8-4c2c-bd1d-6c6a3dd9fe19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d54b6-ffe8-4c44-97c0-5d06f2846e39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca62b9-8e88-4547-b5e8-517237fdb9cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:26 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:48:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70748401-c163-4565-befc-b592d71cbe93]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:48:26 user nova-compute[75095]: DEBUG os_brick.utils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating existing volume attachment record: 9069ce05-0aba-49fc-90f6-95e81435b202 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:27 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:48:27 user nova-compute[75095]: INFO nova.compute.claims [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Claim successful on node user
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:48:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:48:28 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 is timed out.
Nov 15 15:48:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully detached device vdb from instance a0cb19cc-854a-48ff-824a-e63294ffd0e0 from the live domain config.
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrOZfQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:28 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[505a319d-97a2-405d-bee5-ba39445e4126]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:48:28 user nova-compute[75095]: No targets found.
Nov 15 15:48:28 user nova-compute[75095]: iSNS:
Nov 15 15:48:28 user nova-compute[75095]: No targets found.
Nov 15 15:48:28 user nova-compute[75095]: STATIC:
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533
Nov 15 15:48:28 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:48:28 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:48:28 user nova-compute[75095]: FIRMWARE:
Nov 15 15:48:28 user nova-compute[75095]: No targets found.
Nov 15 15:48:28 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:48:28 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:48:28 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb951874-d633-4233-b21e-33bd50077623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e4aea4-f9bf-4fe4-b6e7-34197c5aaf7a]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:28 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c572050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253'): ({'sdf'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Removing single pathed devices sdf {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.policy [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae1f28bb14ba41d583c1b79697cd0c5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23fd461bd6614d7f9ee696faa86b6b79', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb717c8-5844-4c5a-9e60-85ac4cffb93e]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:48:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Creating image(s)
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "/opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "/opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd781bad-81be-4cdb-bf5b-472b91245546]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Flushing IO for device /dev/sdf {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea844676-aedc-48e1-977a-a38b412d2724]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f80eb8-6b56-4658-be7a-de346bdd77bb]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a45781c-5f36-41c4-aa3c-199b76985cc7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.247s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fff216-f4a3-4b5c-b21b-e93bf96bf836]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260]
Nov 15 15:48:29 user nova-compute[75095]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c740a55-bcef-4bbb-92e4-a18185b14253 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[57132559-961f-492a-a178-dad04f08cdef]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] <== disconnect_volume: return (560ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.278s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk 1073741824" returned: 0 in 0.090s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.321s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Cannot resize image /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Ensure instance console log exists: /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Successfully created port: f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:48:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'flavor' on Instance uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d20100c5-bd80-46ac-9a15-a48fc4058ce9 tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.609s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 6.385s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Successfully updated port: f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquired lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-changed-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Refreshing instance network info cache due to event network-changed-f554df74-938a-4593-b082-70f67f0e86ca. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] Acquiring lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Updating instance_info_cache with network_info: [{"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Releasing lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Instance network_info: |[{"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] Acquired lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Refreshing network info cache for port f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Start _get_guest_xml network_info=[{"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:48:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-146368793',display_name='tempest-VolumesNegativeTest-instance-146368793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-146368793',id=22,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23fd461bd6614d7f9ee696faa86b6b79',ramdisk_id='',reservation_id='r-x8wmyw80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-625078258',owner_user_name='tempest-VolumesNegativeTest-625078258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:29Z,user_data=None,user_id='ae1f28bb14ba41d583c1b79697cd0c5c',uuid=5e7f493b-b14d-43bc-8342-fdbc59562923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converting VIF {"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e7f493b-b14d-43bc-8342-fdbc59562923 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:48:32 user nova-compute[75095]:   <uuid>5e7f493b-b14d-43bc-8342-fdbc59562923</uuid>
Nov 15 15:48:32 user nova-compute[75095]:   <name>instance-00000016</name>
Nov 15 15:48:32 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:48:32 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:48:32 user nova-compute[75095]:   <metadata>
Nov 15 15:48:32 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:48:32 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:name>tempest-VolumesNegativeTest-instance-146368793</nova:name>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:48:32</nova:creationTime>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:48:32 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:48:32 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:owner>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:user uuid="ae1f28bb14ba41d583c1b79697cd0c5c">tempest-VolumesNegativeTest-625078258-project-member</nova:user>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:project uuid="23fd461bd6614d7f9ee696faa86b6b79">tempest-VolumesNegativeTest-625078258</nova:project>
Nov 15 15:48:32 user nova-compute[75095]:       </nova:owner>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:48:32 user nova-compute[75095]:       <nova:ports>
Nov 15 15:48:32 user nova-compute[75095]:         <nova:port uuid="f554df74-938a-4593-b082-70f67f0e86ca">
Nov 15 15:48:32 user nova-compute[75095]:           <nova:ip type="fixed" address="192.168.233.70" ipVersion="4"/>
Nov 15 15:48:32 user nova-compute[75095]:         </nova:port>
Nov 15 15:48:32 user nova-compute[75095]:       </nova:ports>
Nov 15 15:48:32 user nova-compute[75095]:     </nova:instance>
Nov 15 15:48:32 user nova-compute[75095]:   </metadata>
Nov 15 15:48:32 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:48:32 user nova-compute[75095]:     <system>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="serial">5e7f493b-b14d-43bc-8342-fdbc59562923</entry>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="uuid">5e7f493b-b14d-43bc-8342-fdbc59562923</entry>
Nov 15 15:48:32 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:48:32 user nova-compute[75095]:     </system>
Nov 15 15:48:32 user nova-compute[75095]:   </sysinfo>
Nov 15 15:48:32 user nova-compute[75095]:   <os>
Nov 15 15:48:32 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:48:32 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:48:32 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:48:32 user nova-compute[75095]:   </os>
Nov 15 15:48:32 user nova-compute[75095]:   <features>
Nov 15 15:48:32 user nova-compute[75095]:     <acpi/>
Nov 15 15:48:32 user nova-compute[75095]:     <apic/>
Nov 15 15:48:32 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:48:32 user nova-compute[75095]:   </features>
Nov 15 15:48:32 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:48:32 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:48:32 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:48:32 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:48:32 user nova-compute[75095]:   </clock>
Nov 15 15:48:32 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:48:32 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:48:32 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:48:32 user nova-compute[75095]:   </cpu>
Nov 15 15:48:32 user nova-compute[75095]:   <devices>
Nov 15 15:48:32 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:48:32 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:48:32 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk"/>
Nov 15 15:48:32 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:48:32 user nova-compute[75095]:     </disk>
Nov 15 15:48:32 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:48:32 user nova-compute[75095]:       <mac address="fa:16:3e:bd:f0:9b"/>
Nov 15 15:48:32 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:32 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:48:32 user nova-compute[75095]:       <target dev="tapf554df74-93"/>
Nov 15 15:48:32 user nova-compute[75095]:     </interface>
Nov 15 15:48:32 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:48:32 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/console.log" append="off"/>
Nov 15 15:48:32 user nova-compute[75095]:     </serial>
Nov 15 15:48:32 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:48:32 user nova-compute[75095]:     <video>
Nov 15 15:48:32 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:32 user nova-compute[75095]:     </video>
Nov 15 15:48:32 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:48:32 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:48:32 user nova-compute[75095]:     </rng>
Nov 15 15:48:32 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:48:32 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:48:32 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:48:32 user nova-compute[75095]:     </memballoon>
Nov 15 15:48:32 user nova-compute[75095]:   </devices>
Nov 15 15:48:32 user nova-compute[75095]: </domain>
Nov 15 15:48:32 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-146368793',display_name='tempest-VolumesNegativeTest-instance-146368793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-146368793',id=22,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23fd461bd6614d7f9ee696faa86b6b79',ramdisk_id='',reservation_id='r-x8wmyw80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-625078258',owner_user_name='tempest-VolumesNegativeTest-625078258-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:29Z,user_data=None,user_id='ae1f28bb14ba41d583c1b79697cd0c5c',uuid=5e7f493b-b14d-43bc-8342-fdbc59562923,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converting VIF {"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG os_vif [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22270cb3-029d-553a-b8fd-6e69bb4806b4', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf554df74-93, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf554df74-93, col_values=(('qos', UUID('e4896609-06d0-4582-8cba-c49cae0c378f')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf554df74-93, col_values=(('external_ids', {'iface-id': 'f554df74-938a-4593-b082-70f67f0e86ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:f0:9b', 'vm-uuid': '5e7f493b-b14d-43bc-8342-fdbc59562923'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:32 user nova-compute[75095]: INFO os_vif [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93')
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] No VIF found with MAC fa:16:3e:bd:f0:9b, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Updated VIF entry in instance network info cache for port f554df74-938a-4593-b082-70f67f0e86ca. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Updating instance_info_cache with network_info: [{"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f709b9b8-b63c-4c5b-8bbc-61fbe9daec22 req-1918bcec-5e91-4b47-b7af-576b759ad741 service nova] Releasing lock "refresh_cache-5e7f493b-b14d-43bc-8342-fdbc59562923" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:48:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Creating image(s)
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Ensure instance console log exists: /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start _get_guest_xml network_info=[{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9069ce05-0aba-49fc-90f6-95e81435b202', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '82639568-19ea-4e63-a23f-c70ead2b2ca6', 'attached_at': '', 'detached_at': '', 'volume_id': '043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'serial': '043b0d1f-799c-41db-9daa-4cbb00e1ac91'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:48:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:34 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:34 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:48:34 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9aefe6-fcde-4ae9-9bd2-3ee12fe49f1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:48:34 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1600ed-8c28-4195-9f48-76078353bd92]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91] added
Nov 15 15:48:34 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[347fbed5-0ac8-4bcf-bea6-e11f1a5f8cfc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.084s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[546144e9-98f2-458c-8fa5-ff940fb479b8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PamiElgp {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PamiElgp" returned: 0 in 0.078s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[268a882a-544a-49d6-ae7a-3b177549f1b4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PamiElgp'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.090s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[946d1aea-7461-4f92-b5ae-82bef788e3f4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5274855f-83dd-4c98-9685-66c2d355adb3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] No waiting events found dispatching network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:35 user nova-compute[75095]: WARNING nova.compute.manager [req-34c7087d-7c84-4633-b806-1c860e9d9047 req-cd2d0798-7dd5-421e-ae5c-982d282069a7 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received unexpected event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca for instance with vm_state building and task_state spawning.
Nov 15 15:48:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --login" returned: 0 in 1.126s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24be488-c836-4feb-a46f-7a9f99282860]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260]
Nov 15 15:48:36 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260] successful.
Nov 15 15:48:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.249s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f93051-348d-46e0-a170-f68153be79c4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc49f9-e96a-4078-aecb-ae7f8a5f31db]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79c43e10-5d10-4e42-b6a4-603246022533 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:48:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.986s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3690a192-6874-4861-8e92-b7ba239b8215]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:48:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] No waiting events found dispatching network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:37 user nova-compute[75095]: WARNING nova.compute.manager [req-b6e69a11-04a2-4add-8ae1-78fc22a017fa req-d9d88f4d-b086-44c6-a974-e328fa287b4b service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received unexpected event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca for instance with vm_state building and task_state spawning.
Nov 15 15:48:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.054s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== connect_volume: return (3056ms) {'type': 'block', 'scsi_wwn': '26433343830636166', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433343830636166', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-964997264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-964997264',id=21,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-86sje3pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:21Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=82639568-19ea-4e63-a23f-c70ead2b2ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:48:37 user nova-compute[75095]:   <uuid>82639568-19ea-4e63-a23f-c70ead2b2ca6</uuid>
Nov 15 15:48:37 user nova-compute[75095]:   <name>instance-00000015</name>
Nov 15 15:48:37 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:48:37 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:48:37 user nova-compute[75095]:   <metadata>
Nov 15 15:48:37 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:48:37 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-964997264</nova:name>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:48:34</nova:creationTime>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:48:37 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:48:37 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:owner>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:48:37 user nova-compute[75095]:       </nova:owner>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:48:37 user nova-compute[75095]:       <nova:ports>
Nov 15 15:48:37 user nova-compute[75095]:         <nova:port uuid="d2faa453-bbaa-47be-b0ed-78821863719b">
Nov 15 15:48:37 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:48:37 user nova-compute[75095]:         </nova:port>
Nov 15 15:48:37 user nova-compute[75095]:       </nova:ports>
Nov 15 15:48:37 user nova-compute[75095]:     </nova:instance>
Nov 15 15:48:37 user nova-compute[75095]:   </metadata>
Nov 15 15:48:37 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:48:37 user nova-compute[75095]:     <system>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="serial">82639568-19ea-4e63-a23f-c70ead2b2ca6</entry>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="uuid">82639568-19ea-4e63-a23f-c70ead2b2ca6</entry>
Nov 15 15:48:37 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:48:37 user nova-compute[75095]:     </system>
Nov 15 15:48:37 user nova-compute[75095]:   </sysinfo>
Nov 15 15:48:37 user nova-compute[75095]:   <os>
Nov 15 15:48:37 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:48:37 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:48:37 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:48:37 user nova-compute[75095]:   </os>
Nov 15 15:48:37 user nova-compute[75095]:   <features>
Nov 15 15:48:37 user nova-compute[75095]:     <acpi/>
Nov 15 15:48:37 user nova-compute[75095]:     <apic/>
Nov 15 15:48:37 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:48:37 user nova-compute[75095]:   </features>
Nov 15 15:48:37 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:48:37 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:48:37 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:48:37 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:48:37 user nova-compute[75095]:   </clock>
Nov 15 15:48:37 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:48:37 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:48:37 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:48:37 user nova-compute[75095]:   </cpu>
Nov 15 15:48:37 user nova-compute[75095]:   <devices>
Nov 15 15:48:37 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:48:37 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:37 user nova-compute[75095]:       <source dev="/dev/sdf"/>
Nov 15 15:48:37 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:48:37 user nova-compute[75095]:       <serial>043b0d1f-799c-41db-9daa-4cbb00e1ac91</serial>
Nov 15 15:48:37 user nova-compute[75095]:     </disk>
Nov 15 15:48:37 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:48:37 user nova-compute[75095]:       <mac address="fa:16:3e:87:51:f1"/>
Nov 15 15:48:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:37 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:48:37 user nova-compute[75095]:       <target dev="tapd2faa453-bb"/>
Nov 15 15:48:37 user nova-compute[75095]:     </interface>
Nov 15 15:48:37 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:48:37 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/console.log" append="off"/>
Nov 15 15:48:37 user nova-compute[75095]:     </serial>
Nov 15 15:48:37 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:48:37 user nova-compute[75095]:     <video>
Nov 15 15:48:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:48:37 user nova-compute[75095]:     </video>
Nov 15 15:48:37 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:48:37 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:48:37 user nova-compute[75095]:     </rng>
Nov 15 15:48:37 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:48:37 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:48:37 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:48:37 user nova-compute[75095]:     </memballoon>
Nov 15 15:48:37 user nova-compute[75095]:   </devices>
Nov 15 15:48:37 user nova-compute[75095]: </domain>
Nov 15 15:48:37 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-964997264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-964997264',id=21,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-86sje3pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:21Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=82639568-19ea-4e63-a23f-c70ead2b2ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG os_vif [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9300edc-86c0-5f61-8ffd-c1344c7e95d5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2faa453-bb, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2faa453-bb, col_values=(('qos', UUID('00a8a971-dbcc-44f8-b695-397f6b4c389f')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2faa453-bb, col_values=(('external_ids', {'iface-id': 'd2faa453-bbaa-47be-b0ed-78821863719b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:51:f1', 'vm-uuid': '82639568-19ea-4e63-a23f-c70ead2b2ca6'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:37 user nova-compute[75095]: INFO os_vif [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb')
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:48:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:87:51:f1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:48:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:48:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:48:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Instance spawned successfully.
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:39 user nova-compute[75095]: INFO nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Took 10.48 seconds to spawn the instance on the hypervisor.
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:39 user nova-compute[75095]: INFO nova.compute.manager [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Took 11.63 seconds to build instance.
Nov 15 15:48:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-71e006cf-8294-482d-a608-b060e44a43bb tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.745s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:39 user nova-compute[75095]: WARNING nova.compute.manager [req-8d9b5413-3f99-46ae-83e0-e1cc441b6306 req-80dd9c39-4bfc-4718-bccf-4cc866581bd4 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state building and task_state spawning.
Nov 15 15:48:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:40 user nova-compute[75095]: INFO nova.compute.manager [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Detaching volume 2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:48:40 user nova-compute[75095]: INFO nova.virt.block_device [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Attempting to driver detach volume 2ac1bd44-405d-4ea3-ae41-1053133da3ec from mountpoint /dev/vdb
Nov 15 15:48:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Attempting to detach device vdb from instance f8acca60-e3f3-412e-bf0f-023ed2943bfc from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:48:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:48:40 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:40 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:48:40 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:40 user nova-compute[75095]:   <serial>2ac1bd44-405d-4ea3-ae41-1053133da3ec</serial>
Nov 15 15:48:40 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:48:40 user nova-compute[75095]: </disk>
Nov 15 15:48:40 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:48:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Successfully detached device vdb from instance f8acca60-e3f3-412e-bf0f-023ed2943bfc from the persistent domain config.
Nov 15 15:48:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8acca60-e3f3-412e-bf0f-023ed2943bfc from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:48:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:48:40 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:48:40 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:48:40 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:48:40 user nova-compute[75095]:   <serial>2ac1bd44-405d-4ea3-ae41-1053133da3ec</serial>
Nov 15 15:48:40 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:48:40 user nova-compute[75095]: </disk>
Nov 15 15:48:40 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:48:41 user nova-compute[75095]: WARNING nova.compute.manager [req-3ea80c17-ac09-40d5-bff2-3a6002f27950 req-d77dbb87-ff4e-47fb-babf-9ad933b0a641 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state building and task_state spawning.
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:48:41 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance spawned successfully.
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:48:41 user nova-compute[75095]: INFO nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 15 15:48:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:48:42 user nova-compute[75095]: INFO nova.compute.manager [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Took 21.77 seconds to build instance.
Nov 15 15:48:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7e0aa6a0-a2a3-478d-ac27-a70824b22301 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.882s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.097s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:42 user nova-compute[75095]: INFO nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 15 15:48:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-changed-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Refreshing instance network info cache due to event network-changed-0f3ba2b5-c398-451e-a695-7dbcaf3c3363. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] Acquiring lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] Acquired lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Refreshing network info cache for port 0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lazy-loading 'flavor' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:56 user nova-compute[75095]: INFO nova.compute.manager [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attaching volume e8363ab5-b525-470a-9c6b-f88cb6869a14 to /dev/vdb
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updated VIF entry in instance network info cache for port 0f3ba2b5-c398-451e-a695-7dbcaf3c3363. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.network.neutron [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updating instance_info_cache with network_info: [{"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d9b97-5b19-4d14-b314-3ee1ad45b92a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f3e0bf7f-85b9-4910-af7d-16cc7b088ece req-3b997d73-cf7e-4139-a424-66e2cd016edd service nova] Releasing lock "refresh_cache-ac60b17f-c938-4031-a439-e28d8563dc75" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f39167d-059a-48bc-a3e5-4b90921c2999]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5503c21-9521-4463-a67f-d290cb7d2944]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce6120e-ed8a-42be-9991-7875892556f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:48:56 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:48:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1766d252-3122-449f-8583-98409d76f121]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:48:56 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updating existing volume attachment record: c754f141-f309-4134-94e7-7796ba2c21ba {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:48:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing instance network info cache due to event network-changed-396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] Acquiring lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] Acquired lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Refreshing network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:58 user nova-compute[75095]: INFO nova.compute.manager [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Terminating instance
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updated VIF entry in instance network info cache for port 396691c5-ae62-4b09-aada-3de27d35eeeb. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating instance_info_cache with network_info: [{"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-995cb22b-aeca-4cd9-9fa2-d056d38330e8 req-16e1c125-cc28-407d-8299-ab078f4c34ac service nova] Releasing lock "refresh_cache-a0cb19cc-854a-48ff-824a-e63294ffd0e0" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Instance destroyed successfully.
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.objects.instance [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'resources' on Instance uuid a0cb19cc-854a-48ff-824a-e63294ffd0e0 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:46:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1541999983',display_name='tempest-TestStampPattern-server-1541999983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1541999983',id=16,image_ref='c0e3ff54-f80d-4339-a560-fd039c59a8a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-fhuou3zt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='37f47320-be8b-4d7a-b8a2-228e4894f881',image_min_disk='1',image_min_ram='0',image_owner_id='08b022d733d2467d869f76f75385c807',image_owner_project_name='tempest-TestStampPattern-1242322391',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1242322391-project-member',image_user_id='00d60e3be37a4596befc5bdf2b796c72',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:46:13Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=a0cb19cc-854a-48ff-824a-e63294ffd0e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "396691c5-ae62-4b09-aada-3de27d35eeeb", "address": "fa:16:3e:54:85:c0", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap396691c5-ae", "ovs_interfaceid": "396691c5-ae62-4b09-aada-3de27d35eeeb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG os_vif [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap396691c5-ae, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e12ada46-1613-4e23-9e9c-0a0a2c9c8e2e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: INFO os_vif [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:85:c0,bridge_name='br-int',has_traffic_filtering=True,id=396691c5-ae62-4b09-aada-3de27d35eeeb,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap396691c5-ae')
Nov 15 15:48:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Deleting instance files /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0_del
Nov 15 15:48:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Deletion of /opt/stack/data/nova/instances/a0cb19cc-854a-48ff-824a-e63294ffd0e0_del complete
Nov 15 15:48:59 user nova-compute[75095]: INFO nova.compute.manager [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:48:59 user nova-compute[75095]: INFO nova.compute.manager [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Terminating instance
Nov 15 15:48:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:48:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:00 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Took 0.59 seconds to deallocate network for instance.
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2fa564b6-da7a-4f3b-b925-80475bb7b4d1 req-0d9fd295-1155-48ed-ba8a-4dabd630a711 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-vif-deleted-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-vif-unplugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] No waiting events found dispatching network-vif-unplugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:00 user nova-compute[75095]: WARNING nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received unexpected event network-vif-unplugged-396691c5-ae62-4b09-aada-3de27d35eeeb for instance with vm_state deleted and task_state None.
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Acquiring lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] No waiting events found dispatching network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:00 user nova-compute[75095]: WARNING nova.compute.manager [req-6896d7b7-85bf-4b86-852f-54c436e47b77 req-0349cdac-5442-43ac-836d-f2d57035e2a7 service nova] [instance: a0cb19cc-854a-48ff-824a-e63294ffd0e0] Received unexpected event network-vif-plugged-396691c5-ae62-4b09-aada-3de27d35eeeb for instance with vm_state deleted and task_state None.
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:00 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Deleted allocations for instance a0cb19cc-854a-48ff-824a-e63294ffd0e0
Nov 15 15:49:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Instance destroyed successfully.
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid e60f1b14-84e3-41c4-a11a-fed0ff42202b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358675589',display_name='tempest-TestVolumeBootPattern-server-1358675589',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358675589',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-ouj0t8qp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:27Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=e60f1b14-84e3-41c4-a11a-fed0ff42202b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "aef0929d-c897-472b-80de-db709cb81927", "address": "fa:16:3e:f4:30:af", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaef0929d-c8", "ovs_interfaceid": "aef0929d-c897-472b-80de-db709cb81927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_vif [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaef0929d-c8, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffcae3f4-bdb8-4412-ba64-b9620a994be9) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:00 user nova-compute[75095]: INFO os_vif [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:30:af,bridge_name='br-int',has_traffic_filtering=True,id=aef0929d-c897-472b-80de-db709cb81927,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaef0929d-c8')
Nov 15 15:49:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htkdMpTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:00 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-db85c374-73e1-4689-8054-8b6ed09da44c tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "a0cb19cc-854a-48ff-824a-e63294ffd0e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c70b42-9baf-4956-9634-ddf49ee34875]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:49:00 user nova-compute[75095]: No targets found.
Nov 15 15:49:00 user nova-compute[75095]: iSNS:
Nov 15 15:49:00 user nova-compute[75095]: No targets found.
Nov 15 15:49:00 user nova-compute[75095]: STATIC:
Nov 15 15:49:00 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321
Nov 15 15:49:00 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:00 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:00 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:49:00 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:00 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:00 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:49:00 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:00 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:00 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:49:00 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:00 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:00 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:49:00 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:00 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:00 user nova-compute[75095]: FIRMWARE:
Nov 15 15:49:00 user nova-compute[75095]: No targets found.
Nov 15 15:49:00 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:49:00 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:49:00 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[697850a6-ea0e-4172-8853-f77dc1c80ce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[482317a9-2db7-4a97-8c14-add7d7218cf5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:00 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3de680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[330bed52-078c-4d6b-83d8-9e07f951b28c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3160b33-d6dd-4be7-bad6-94b7db7b063b]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34130c-8a7a-4e8b-b097-0606c6a44f8a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae325e47-7a1d-4ec9-862d-89f91e00ecfc]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f165b-8d87-471e-bf63-0d2f2cd4192c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b71a14-b026-416a-b9a3-aca453348d93]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260]
Nov 15 15:49:01 user nova-compute[75095]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb156cb3-50c7-47ca-bfc4-132ffb83a321 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aff218-864d-464c-ad40-a3bc5cc056f3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (352ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:49:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Deleting instance files /opt/stack/data/nova/instances/e60f1b14-84e3-41c4-a11a-fed0ff42202b_del
Nov 15 15:49:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Deletion of /opt/stack/data/nova/instances/e60f1b14-84e3-41c4-a11a-fed0ff42202b_del complete
Nov 15 15:49:01 user nova-compute[75095]: INFO nova.compute.manager [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:49:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f8acca60-e3f3-412e-bf0f-023ed2943bfc is timed out.
Nov 15 15:49:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Successfully detached device vdb from instance f8acca60-e3f3-412e-bf0f-023ed2943bfc from the live domain config.
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NAvwTrHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[338f6a0a-4349-4a5e-86cf-aaa42207a7e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:49:01 user nova-compute[75095]: No targets found.
Nov 15 15:49:01 user nova-compute[75095]: iSNS:
Nov 15 15:49:01 user nova-compute[75095]: No targets found.
Nov 15 15:49:01 user nova-compute[75095]: STATIC:
Nov 15 15:49:01 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:49:01 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:01 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:01 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:49:01 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:01 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:01 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:49:01 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:01 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:01 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec
Nov 15 15:49:01 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:01 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:01 user nova-compute[75095]: FIRMWARE:
Nov 15 15:49:01 user nova-compute[75095]: No targets found.
Nov 15 15:49:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:49:01 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:49:01 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a08638e-2c5c-4bff-87a2-0579e77c44ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ce3ed0-30fe-4e17-8844-4493f94b5071]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3de830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f5103a-1dfc-40d9-828d-c24214f6910e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cdf8e3-cad5-455d-8b19-d12bcdee2d7d]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d1318b-1400-4136-af59-31a74d5cc4bd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a714fba-db5a-45de-bf63-e439a0eb56fb]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d70646-5594-4fd7-98da-c54a403af50b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[248a91df-8f1a-4b92-9a85-6e7777250282]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260]
Nov 15 15:49:01 user nova-compute[75095]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2ac1bd44-405d-4ea3-ae41-1053133da3ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c55a72-fcc8-4ac1-97d8-2bf79c9f1fbc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] <== disconnect_volume: return (331ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:49:01 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:01 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Took 0.53 seconds to deallocate network for instance.
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-unplugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] No waiting events found dispatching network-vif-unplugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-unplugged-aef0929d-c897-472b-80de-db709cb81927 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Acquiring lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] No waiting events found dispatching network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:02 user nova-compute[75095]: WARNING nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received unexpected event network-vif-plugged-aef0929d-c897-472b-80de-db709cb81927 for instance with vm_state active and task_state deleting.
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-49d1b0eb-cc35-4e2d-90d8-47314dc36ddf req-04d5de07-5daa-475a-a722-bb8caa4ba0d8 service nova] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Received event network-vif-deleted-aef0929d-c897-472b-80de-db709cb81927 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'flavor' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c10e7438-71f4-4720-a779-d550cef19301 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.104s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:02 user nova-compute[75095]: INFO nova.compute.manager [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Took 1.28 seconds to detach 1 volumes for instance.
Nov 15 15:49:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: e60f1b14-84e3-41c4-a11a-fed0ff42202b] Deleting volume: bb156cb3-50c7-47ca-bfc4-132ffb83a321 {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.392s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:03 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance e60f1b14-84e3-41c4-a11a-fed0ff42202b
Nov 15 15:49:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3649ffff-d050-49f7-befb-c7ac7a6c89ce tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "e60f1b14-84e3-41c4-a11a-fed0ff42202b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.696s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:04 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf37ac2-2674-40f7-84f4-e7c9056a4ef6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:49:04 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56cf641-1d22-43e1-b772-7d117e7ee4fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14] added
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae81516f-d2c9-4b64-b53b-5b224cc13584]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f99fc17-56e2-4798-b74e-aee35011590b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHJjqPMN {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHJjqPMN" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec5bbc1-7159-456c-a957-754548a9bd4e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHJjqPMN'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9664e05-17f8-4bd5-ad8b-9c7ac17254e4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3163aaa6-384a-48c6-9757-0a0d95ae88dc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[301d5c85-08e5-4cbf-a3cd-5be9c4cfdc9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]
Nov 15 15:49:04 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[469852d2-8fbb-41dd-b0fb-425968c6838d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ba4d3c-8394-423f-b9ca-fc310c414d06]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2448f22c-b2a1-48bd-b6e3-9a4ab9534b5e]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23530313530646366', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530313530646366', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lazy-loading 'flavor' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:49:05 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:49:05 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:49:05 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:49:05 user nova-compute[75095]:   <serial>e8363ab5-b525-470a-9c6b-f88cb6869a14</serial>
Nov 15 15:49:05 user nova-compute[75095]: </disk>
Nov 15 15:49:05 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:49:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] No VIF found with MAC fa:16:3e:f4:71:3e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2391feda-85b6-478f-8613-f620600d4a38 tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.549s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:49:06 user nova-compute[75095]: INFO nova.compute.claims [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Claim successful on node user
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:49:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:49:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.policy [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6be20f91b01f48c7a4b4d271b9c05954', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04921366d7b34598b95002d0582de4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:49:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Creating image(s)
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "/opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "/opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "/opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.239s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk 1073741824" returned: 0 in 0.059s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Successfully created port: 71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.utils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cca28-b47c-4f9d-8cdd-8858b33501d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f7dc7c-8506-42a6-b61b-73fd71bdd030]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca5555c-87d5-42d8-9303-29eb6861e578]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e74dd08-5542-4653-b5c2-f52f7a8ebf0b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:49:07 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:49:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d5e0b8-dead-488f-92fa-4335cc16c9d4]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:49:07 user nova-compute[75095]: DEBUG os_brick.utils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:07 user nova-compute[75095]: INFO nova.compute.manager [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Swapping volume e8363ab5-b525-470a-9c6b-f88cb6869a14 for c95b63db-dc8e-438b-a33d-6f8c764eb957
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Cannot resize image /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Ensure instance console log exists: /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Successfully updated port: 71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquired lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-changed-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Refreshing instance network info cache due to event network-changed-71448237-520d-453f-bcf7-9b1e1009bc68. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] Acquiring lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Updating instance_info_cache with network_info: [{"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Releasing lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Instance network_info: |[{"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] Acquired lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Refreshing network info cache for port 71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Start _get_guest_xml network_info=[{"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-659751637',display_name='tempest-ServersNegativeTestJSON-server-659751637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-659751637',id=23,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-01bzo9wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:49:07Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=a552ab2a-2123-45c2-914f-16e558f12af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lazy-loading 'pci_devices' on Instance uuid a552ab2a-2123-45c2-914f-16e558f12af4 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:49:08 user nova-compute[75095]:   <uuid>a552ab2a-2123-45c2-914f-16e558f12af4</uuid>
Nov 15 15:49:08 user nova-compute[75095]:   <name>instance-00000017</name>
Nov 15 15:49:08 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:49:08 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:49:08 user nova-compute[75095]:   <metadata>
Nov 15 15:49:08 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:49:08 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:name>tempest-ServersNegativeTestJSON-server-659751637</nova:name>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:49:08</nova:creationTime>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:49:08 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:49:08 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:owner>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:user uuid="6be20f91b01f48c7a4b4d271b9c05954">tempest-ServersNegativeTestJSON-981531680-project-member</nova:user>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:project uuid="04921366d7b34598b95002d0582de4d6">tempest-ServersNegativeTestJSON-981531680</nova:project>
Nov 15 15:49:08 user nova-compute[75095]:       </nova:owner>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:49:08 user nova-compute[75095]:       <nova:ports>
Nov 15 15:49:08 user nova-compute[75095]:         <nova:port uuid="71448237-520d-453f-bcf7-9b1e1009bc68">
Nov 15 15:49:08 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:49:08 user nova-compute[75095]:         </nova:port>
Nov 15 15:49:08 user nova-compute[75095]:       </nova:ports>
Nov 15 15:49:08 user nova-compute[75095]:     </nova:instance>
Nov 15 15:49:08 user nova-compute[75095]:   </metadata>
Nov 15 15:49:08 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:49:08 user nova-compute[75095]:     <system>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="serial">a552ab2a-2123-45c2-914f-16e558f12af4</entry>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="uuid">a552ab2a-2123-45c2-914f-16e558f12af4</entry>
Nov 15 15:49:08 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:49:08 user nova-compute[75095]:     </system>
Nov 15 15:49:08 user nova-compute[75095]:   </sysinfo>
Nov 15 15:49:08 user nova-compute[75095]:   <os>
Nov 15 15:49:08 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:49:08 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:49:08 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:49:08 user nova-compute[75095]:   </os>
Nov 15 15:49:08 user nova-compute[75095]:   <features>
Nov 15 15:49:08 user nova-compute[75095]:     <acpi/>
Nov 15 15:49:08 user nova-compute[75095]:     <apic/>
Nov 15 15:49:08 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:49:08 user nova-compute[75095]:   </features>
Nov 15 15:49:08 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:49:08 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:49:08 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:49:08 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:49:08 user nova-compute[75095]:   </clock>
Nov 15 15:49:08 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:49:08 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:49:08 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:49:08 user nova-compute[75095]:   </cpu>
Nov 15 15:49:08 user nova-compute[75095]:   <devices>
Nov 15 15:49:08 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:49:08 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:49:08 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk"/>
Nov 15 15:49:08 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:49:08 user nova-compute[75095]:     </disk>
Nov 15 15:49:08 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:49:08 user nova-compute[75095]:       <mac address="fa:16:3e:40:f3:e1"/>
Nov 15 15:49:08 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:49:08 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:49:08 user nova-compute[75095]:       <target dev="tap71448237-52"/>
Nov 15 15:49:08 user nova-compute[75095]:     </interface>
Nov 15 15:49:08 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:49:08 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/console.log" append="off"/>
Nov 15 15:49:08 user nova-compute[75095]:     </serial>
Nov 15 15:49:08 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:49:08 user nova-compute[75095]:     <video>
Nov 15 15:49:08 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:49:08 user nova-compute[75095]:     </video>
Nov 15 15:49:08 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:49:08 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:49:08 user nova-compute[75095]:     </rng>
Nov 15 15:49:08 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:49:08 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:49:08 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:49:08 user nova-compute[75095]:     </memballoon>
Nov 15 15:49:08 user nova-compute[75095]:   </devices>
Nov 15 15:49:08 user nova-compute[75095]: </domain>
Nov 15 15:49:08 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-659751637',display_name='tempest-ServersNegativeTestJSON-server-659751637',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-659751637',id=23,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-01bzo9wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:49:07Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=a552ab2a-2123-45c2-914f-16e558f12af4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG os_vif [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d832363-9bf6-5c5f-abae-aaa4338e5ac0', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71448237-52, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71448237-52, col_values=(('qos', UUID('bfb71098-e4e5-49cd-b7bc-6873916e0b0e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71448237-52, col_values=(('external_ids', {'iface-id': '71448237-520d-453f-bcf7-9b1e1009bc68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:f3:e1', 'vm-uuid': 'a552ab2a-2123-45c2-914f-16e558f12af4'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:08 user nova-compute[75095]: INFO os_vif [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52')
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:49:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] No VIF found with MAC fa:16:3e:40:f3:e1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:49:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Updated VIF entry in instance network info cache for port 71448237-520d-453f-bcf7-9b1e1009bc68. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:49:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Updating instance_info_cache with network_info: [{"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8795eec9-f2bf-47bf-bd22-41e5919519d3 req-bfede2c4-7cf2-402f-b768-4cdf3f36d88c service nova] Releasing lock "refresh_cache-a552ab2a-2123-45c2-914f-16e558f12af4" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] No waiting events found dispatching network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:10 user nova-compute[75095]: WARNING nova.compute.manager [req-e7826b24-f964-4f12-b337-332ea0c98141 req-bebd67e1-6269-4cc5-a499-75a74d600ff7 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received unexpected event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 for instance with vm_state building and task_state spawning.
Nov 15 15:49:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:49:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Instance spawned successfully.
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] No waiting events found dispatching network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:12 user nova-compute[75095]: WARNING nova.compute.manager [req-ceef2de4-8509-4f77-bedc-de0def244625 req-c04834d9-8485-4c0c-9177-63aaa9b6779d service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received unexpected event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 for instance with vm_state building and task_state spawning.
Nov 15 15:49:12 user nova-compute[75095]: INFO nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:49:12 user nova-compute[75095]: INFO nova.compute.manager [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Took 6.09 seconds to build instance.
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9c4e5279-f319-441b-aa74-1fff77d250f7 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.187s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957', 'serial': 'c95b63db-dc8e-438b-a33d-6f8c764eb957'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8363ab5-b525-470a-9c6b-f88cb6869a14', 'serial'} {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:12 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:12 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:12 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[375be3a4-e194-46d4-94bb-a302767b134b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:49:12 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a78b0a-fc69-4365-8d57-2e011aa35210]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957] added
Nov 15 15:49:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98bde58-89dc-419b-bd2d-a58e90d1e872]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ddf4e76-5e19-4c37-acb2-77c34db25469]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlikyPgK {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rlikyPgK" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09973962-0849-4248-9dfb-ff716ca5d42d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rlikyPgK'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e59fe8-720f-4898-89f1-e497a189c8ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad730a9-10b6-4b82-89b1-51c76302e834]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b8db61-b7b7-4b24-9b62-c6b83810f58f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260]
Nov 15 15:49:13 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a615a-3802-47ca-b40d-1fc4eed0fbfc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa379e86-6c94-4916-9b62-95e6b97e84f5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b56754-67ae-4d09-885d-a5d69be3e7a8]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23066323832633362', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066323832633362', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lazy-loading 'flavor' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 157286400 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 328204288 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 506462208 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 666894336 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 816840704 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 954204160 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7166MB free_disk=24.341659545898438GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:18 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6907f2a9-fcda-41e3-a395-abf7aaecff6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:49:18 user nova-compute[75095]: No targets found.
Nov 15 15:49:18 user nova-compute[75095]: iSNS:
Nov 15 15:49:18 user nova-compute[75095]: No targets found.
Nov 15 15:49:18 user nova-compute[75095]: STATIC:
Nov 15 15:49:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:49:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:49:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14
Nov 15 15:49:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:49:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957
Nov 15 15:49:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:18 user nova-compute[75095]: FIRMWARE:
Nov 15 15:49:18 user nova-compute[75095]: No targets found.
Nov 15 15:49:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:49:18 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:49:18 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460dbf8-6ec5-412e-93d6-43040eaabca3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[80443fb5-f1c1-4065-8c94-3bc786d071bf]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c4dc5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 37f47320-be8b-4d7a-b8a2-228e4894f881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7447d0b9-3152-49ab-8576-994810c20e29 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ac60b17f-c938-4031-a439-e28d8563dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b88184a5-9c2d-4005-a46a-f595b7be5efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 5e7f493b-b14d-43bc-8342-fdbc59562923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance a552ab2a-2123-45c2-914f-16e558f12af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dff7d9-80af-4a7b-a168-89b282977180]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8be30e-995f-4d7a-9119-07991813cf93]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abcfd42-6aca-45ad-b5cd-91b02196cf2e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:49:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743ad2d-c272-45d2-bca9-c2472d24b001]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.072s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[405c87ce-2e33-4cca-9991-e6706be6d3db]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff92c50c-4bb0-420c-af0a-ab88d7c656c3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]
Nov 15 15:49:19 user nova-compute[75095]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c78c50c-af68-42da-b813-77f6e5bfa678]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== disconnect_volume: return (399ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957', 'serial'} {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: removing Cinder connection for volume e8363ab5-b525-470a-9c6b-f88cb6869a14 {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.598s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:49:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:49:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: Updating volume e8363ab5-b525-470a-9c6b-f88cb6869a14 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "rlikyPgK", "auth_password": "HeY0pzEMFIBAy9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "c95b63db-dc8e-438b-a33d-6f8c764eb957"}, "status": "reserved", "instance": "ac60b17f-c938-4031-a439-e28d8563dc75", "attached_at": "", "detached_at": "", "volume_id": "c95b63db-dc8e-438b-a33d-6f8c764eb957", "serial": "c95b63db-dc8e-438b-a33d-6f8c764eb957"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957', 'no_device': None, 'attachment_id': 'b3b0f81a-ce71-4073-b78b-5f05c0011a14'} {{(pid=75095) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 15:49:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-eaef8f6e-1638-4971-8a46-399b3955af8e tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.360s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f2cbb6-fa4b-4ca3-a13c-0ee2f019480e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a39c0a5-bd68-4158-8fbf-1550449574a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2be6331-1435-4b72-afc2-bcd3a814ca1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3031ab70-2e27-409b-b7e3-2bea26488d79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:49:21 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:49:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb64aad-2c14-4858-8d70-5f3ff739b9a3]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:49:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:21 user nova-compute[75095]: INFO nova.compute.manager [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Swapping volume c95b63db-dc8e-438b-a33d-6f8c764eb957 for e8363ab5-b525-470a-9c6b-f88cb6869a14
Nov 15 15:49:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8363ab5-b525-470a-9c6b-f88cb6869a14', 'serial': 'e8363ab5-b525-470a-9c6b-f88cb6869a14'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957'}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957', 'serial'} {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:26 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d9587-0319-4282-8e6f-e0ea9928451e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:49:26 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368960d-33bd-4fb6-bc85-8a29c2a45f49]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14] added
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d270aef0-8384-4ef6-864a-0f4f73acb076]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e20a01-8b11-4a13-8b53-1df74a5f19e0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHJjqPMN {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHJjqPMN" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a2bd4b-dc8b-4c4f-bd15-42a59b048e9f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHJjqPMN'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada21045-d517-4c42-9d1f-7c7bbae398c4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6b839e-02b0-4115-a36a-51a65bc06a1d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb2fe55-8060-4bda-ba65-9bb5e812e38a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]
Nov 15 15:49:26 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7a41e7-981c-4232-bfb2-8636935c20d3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da0c871-f1ac-4567-ae14-10fd1b6e3a41]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9203628a-370b-4521-ad8b-44a94b2019f8]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23530313530646366', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530313530646366', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:49:27 user nova-compute[75095]: DEBUG nova.objects.instance [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lazy-loading 'flavor' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 134217728 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 243269632 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 390070272 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 560988160 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 721420288 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:31 user nova-compute[75095]: INFO nova.compute.manager [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Terminating instance
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 884998144 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 1013972992 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-f8455242-b414-4660-88c9-d2b5b779869a req-9fd2d038-ba6c-4a8a-9960-d6b02a2dc9c9 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-unplugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Instance destroyed successfully.
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lazy-loading 'resources' on Instance uuid f8acca60-e3f3-412e-bf0f-023ed2943bfc {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1967741566',display_name='tempest-ServerStableDeviceRescueTest-server-1967741566',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1967741566',id=4,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBBUOIfdbDk/brXXiylka2/btdkrjY3diz7DKadf13/ZIXcRbgTpOTtE06UY9cDwKBRHgGAHt69/VENIJfjafbfdolZpGClTyfIfX148jIcxUAMRahY1njiu0GNtx6ilXg==',key_name='tempest-keypair-112033150',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ed810aaa216455bb359448237bb716b',ramdisk_id='',reservation_id='r-m4a5wyj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1847037719',owner_user_name='tempest-ServerStableDeviceRescueTest-1847037719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:48:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1b18bf4b448346beaea19f95e59ea778',uuid=f8acca60-e3f3-412e-bf0f-023ed2943bfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converting VIF {"id": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "address": "fa:16:3e:e5:60:f6", "network": {"id": "f6e0eddf-80d4-4caf-8744-d83a7825e038", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2074997990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ed810aaa216455bb359448237bb716b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8c2c859-33", "ovs_interfaceid": "b8c2c859-3325-4d81-a66f-fb84a4115cfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_vif [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8c2c859-33, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d619decd-3dd3-4859-a998-5c2fcc1bceb0) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:32 user nova-compute[75095]: INFO os_vif [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:60:f6,bridge_name='br-int',has_traffic_filtering=True,id=b8c2c859-3325-4d81-a66f-fb84a4115cfd,network=Network(f6e0eddf-80d4-4caf-8744-d83a7825e038),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8c2c859-33')
Nov 15 15:49:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Deleting instance files /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc_del
Nov 15 15:49:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Deletion of /opt/stack/data/nova/instances/f8acca60-e3f3-412e-bf0f-023ed2943bfc_del complete
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:49:32 user nova-compute[75095]: INFO nova.compute.manager [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rlikyPgK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'c95b63db-dc8e-438b-a33d-6f8c764eb957'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:32 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84360d40-492e-45a0-b7d1-0925028f297c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:49:32 user nova-compute[75095]: No targets found.
Nov 15 15:49:32 user nova-compute[75095]: iSNS:
Nov 15 15:49:32 user nova-compute[75095]: No targets found.
Nov 15 15:49:32 user nova-compute[75095]: STATIC:
Nov 15 15:49:32 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:49:32 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:32 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:32 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:49:32 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:32 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:32 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14
Nov 15 15:49:32 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:32 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:32 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:49:32 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:32 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:32 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957
Nov 15 15:49:32 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:32 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:32 user nova-compute[75095]: FIRMWARE:
Nov 15 15:49:32 user nova-compute[75095]: No targets found.
Nov 15 15:49:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:49:32 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:49:32 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8db3a-7da2-4b56-9885-03338dbd2788]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[943df26d-23fd-4d15-9e08-c20959cf6f21]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2e8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4751ef3-b4dd-4f07-9801-93e4692559b6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3e60a-ccdc-4ecd-a129-bb7cde6c2797]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efd0496-43cc-44cd-976c-5a30a5fbed14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01755f1d-b720-42ef-bac9-0de4a2c44bac]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aa9af0-8209-4844-85b0-f6813d761089]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d95f603-4f3b-4ed1-b16e-f3ce25f6478e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260]
Nov 15 15:49:32 user nova-compute[75095]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c95b63db-dc8e-438b-a33d-6f8c764eb957 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab89124-02e8-44fd-b39f-ed8d571761e3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] <== disconnect_volume: return (342ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ac60b17f-c938-4031-a439-e28d8563dc75', 'attached_at': '', 'detached_at': '', 'volume_id': 'e8363ab5-b525-470a-9c6b-f88cb6869a14', 'serial'} {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 15:49:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: removing Cinder connection for volume c95b63db-dc8e-438b-a33d-6f8c764eb957 {{(pid=75095) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:33 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Took 0.75 seconds to deallocate network for instance.
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-5f25fb5f-61a8-41d1-8549-3967388d8704 req-e425ce88-3b46-4921-be1a-8aef058fe1f0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-deleted-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:33 user nova-compute[75095]: INFO nova.compute.manager [req-5f25fb5f-61a8-41d1-8549-3967388d8704 req-e425ce88-3b46-4921-be1a-8aef058fe1f0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Neutron deleted interface b8c2c859-3325-4d81-a66f-fb84a4115cfd; detaching it from the instance and deleting it from the info cache
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.network.neutron [req-5f25fb5f-61a8-41d1-8549-3967388d8704 req-e425ce88-3b46-4921-be1a-8aef058fe1f0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-5f25fb5f-61a8-41d1-8549-3967388d8704 req-e425ce88-3b46-4921-be1a-8aef058fe1f0 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Detach interface failed, port_id=b8c2c859-3325-4d81-a66f-fb84a4115cfd, reason: Instance f8acca60-e3f3-412e-bf0f-023ed2943bfc could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:33 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Deleted allocations for instance f8acca60-e3f3-412e-bf0f-023ed2943bfc
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] swap_volume: Updating volume c95b63db-dc8e-438b-a33d-6f8c764eb957 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mHJjqPMN", "auth_password": "c6ZSusvtj3RIB0", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "e8363ab5-b525-470a-9c6b-f88cb6869a14"}, "status": "reserved", "instance": "ac60b17f-c938-4031-a439-e28d8563dc75", "attached_at": "", "detached_at": "", "volume_id": "e8363ab5-b525-470a-9c6b-f88cb6869a14", "serial": "e8363ab5-b525-470a-9c6b-f88cb6869a14"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'e8363ab5-b525-470a-9c6b-f88cb6869a14', 'no_device': None, 'attachment_id': '5004b375-50d6-414d-96a3-db893e23a630'} {{(pid=75095) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-aa6b1ec0-5afb-473a-b5cc-486dae38bf26 tempest-ServerStableDeviceRescueTest-1847037719 tempest-ServerStableDeviceRescueTest-1847037719-project-member] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.512s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-67769ff4-97b1-459b-9e8d-364549e56669 tempest-TestVolumeSwap-497905670 tempest-TestVolumeSwap-497905670-project-admin] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.612s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] Acquiring lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] Lock "f8acca60-e3f3-412e-bf0f-023ed2943bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] No waiting events found dispatching network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:33 user nova-compute[75095]: WARNING nova.compute.manager [req-0bbcd330-1a60-4252-8ccd-e47adbd90fb8 req-f62b5682-6e36-429e-9443-c5f81c1ef674 service nova] [instance: f8acca60-e3f3-412e-bf0f-023ed2943bfc] Received unexpected event network-vif-plugged-b8c2c859-3325-4d81-a66f-fb84a4115cfd for instance with vm_state deleted and task_state None.
Nov 15 15:49:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:34 user nova-compute[75095]: INFO nova.compute.manager [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Detaching volume e8363ab5-b525-470a-9c6b-f88cb6869a14
Nov 15 15:49:34 user nova-compute[75095]: INFO nova.virt.block_device [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Attempting to driver detach volume e8363ab5-b525-470a-9c6b-f88cb6869a14 from mountpoint /dev/vdb
Nov 15 15:49:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Attempting to detach device vdb from instance ac60b17f-c938-4031-a439-e28d8563dc75 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:49:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:49:34 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:49:34 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:49:34 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:49:34 user nova-compute[75095]:   <serial>e8363ab5-b525-470a-9c6b-f88cb6869a14</serial>
Nov 15 15:49:34 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:49:34 user nova-compute[75095]: </disk>
Nov 15 15:49:34 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:49:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Successfully detached device vdb from instance ac60b17f-c938-4031-a439-e28d8563dc75 from the persistent domain config.
Nov 15 15:49:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac60b17f-c938-4031-a439-e28d8563dc75 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:49:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:49:34 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:49:34 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:49:34 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:49:34 user nova-compute[75095]:   <serial>e8363ab5-b525-470a-9c6b-f88cb6869a14</serial>
Nov 15 15:49:34 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:49:34 user nova-compute[75095]: </disk>
Nov 15 15:49:34 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:49:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:49:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:49:45 user nova-compute[75095]: INFO nova.compute.claims [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Claim successful on node user
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:49:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.policy [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122adc4dbe90486f8eed85dce6910d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846a2bf6258b4e8eab8705b70442b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:49:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Creating image(s)
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "/opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "/opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk 1073741824" returned: 0 in 0.063s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Successfully created port: 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Cannot resize image /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Ensure instance console log exists: /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Successfully updated port: 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquired lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-changed-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Refreshing instance network info cache due to event network-changed-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] Acquiring lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updating instance_info_cache with network_info: [{"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Releasing lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Instance network_info: |[{"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] Acquired lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Refreshing network info cache for port 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Start _get_guest_xml network_info=[{"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:49:48 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:48 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1307889443',display_name='tempest-VolumesSnapshotTestJSON-instance-1307889443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1307889443',id=24,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcdsLgiF8QTtS44Pqcnvv3KYAi+0LqpHVHe4yLR5f7zVyNfTySvJZaiQhGZD+bfwqzdOVcyKmtJeK9wXRFhWL0YysYwv1/BVbJPgLQ91I66bjBW131yPT8JeAk1q96yWA==',key_name='tempest-keypair-100941630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-14juu7az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=34b46dc8-281e-49bb-96ce-1494e2d7e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:49:48 user nova-compute[75095]:   <uuid>34b46dc8-281e-49bb-96ce-1494e2d7e04f</uuid>
Nov 15 15:49:48 user nova-compute[75095]:   <name>instance-00000018</name>
Nov 15 15:49:48 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:49:48 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:49:48 user nova-compute[75095]:   <metadata>
Nov 15 15:49:48 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:49:48 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1307889443</nova:name>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:49:48</nova:creationTime>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:49:48 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:49:48 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:owner>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:user uuid="122adc4dbe90486f8eed85dce6910d4f">tempest-VolumesSnapshotTestJSON-1176209995-project-member</nova:user>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:project uuid="846a2bf6258b4e8eab8705b70442b9f8">tempest-VolumesSnapshotTestJSON-1176209995</nova:project>
Nov 15 15:49:48 user nova-compute[75095]:       </nova:owner>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:49:48 user nova-compute[75095]:       <nova:ports>
Nov 15 15:49:48 user nova-compute[75095]:         <nova:port uuid="9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae">
Nov 15 15:49:48 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 15:49:48 user nova-compute[75095]:         </nova:port>
Nov 15 15:49:48 user nova-compute[75095]:       </nova:ports>
Nov 15 15:49:48 user nova-compute[75095]:     </nova:instance>
Nov 15 15:49:48 user nova-compute[75095]:   </metadata>
Nov 15 15:49:48 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:49:48 user nova-compute[75095]:     <system>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="serial">34b46dc8-281e-49bb-96ce-1494e2d7e04f</entry>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="uuid">34b46dc8-281e-49bb-96ce-1494e2d7e04f</entry>
Nov 15 15:49:48 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:49:48 user nova-compute[75095]:     </system>
Nov 15 15:49:48 user nova-compute[75095]:   </sysinfo>
Nov 15 15:49:48 user nova-compute[75095]:   <os>
Nov 15 15:49:48 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:49:48 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:49:48 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:49:48 user nova-compute[75095]:   </os>
Nov 15 15:49:48 user nova-compute[75095]:   <features>
Nov 15 15:49:48 user nova-compute[75095]:     <acpi/>
Nov 15 15:49:48 user nova-compute[75095]:     <apic/>
Nov 15 15:49:48 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:49:48 user nova-compute[75095]:   </features>
Nov 15 15:49:48 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:49:48 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:49:48 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:49:48 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:49:48 user nova-compute[75095]:   </clock>
Nov 15 15:49:48 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:49:48 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:49:48 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:49:48 user nova-compute[75095]:   </cpu>
Nov 15 15:49:48 user nova-compute[75095]:   <devices>
Nov 15 15:49:48 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:49:48 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:49:48 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk"/>
Nov 15 15:49:48 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:49:48 user nova-compute[75095]:     </disk>
Nov 15 15:49:48 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:49:48 user nova-compute[75095]:       <mac address="fa:16:3e:e7:b1:19"/>
Nov 15 15:49:48 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:49:48 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:49:48 user nova-compute[75095]:       <target dev="tap9c4f4d1c-83"/>
Nov 15 15:49:48 user nova-compute[75095]:     </interface>
Nov 15 15:49:48 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:49:48 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/console.log" append="off"/>
Nov 15 15:49:48 user nova-compute[75095]:     </serial>
Nov 15 15:49:48 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:49:48 user nova-compute[75095]:     <video>
Nov 15 15:49:48 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:49:48 user nova-compute[75095]:     </video>
Nov 15 15:49:48 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:49:48 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:49:48 user nova-compute[75095]:     </rng>
Nov 15 15:49:48 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:49:48 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:49:48 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:49:48 user nova-compute[75095]:     </memballoon>
Nov 15 15:49:48 user nova-compute[75095]:   </devices>
Nov 15 15:49:48 user nova-compute[75095]: </domain>
Nov 15 15:49:48 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1307889443',display_name='tempest-VolumesSnapshotTestJSON-instance-1307889443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1307889443',id=24,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcdsLgiF8QTtS44Pqcnvv3KYAi+0LqpHVHe4yLR5f7zVyNfTySvJZaiQhGZD+bfwqzdOVcyKmtJeK9wXRFhWL0YysYwv1/BVbJPgLQ91I66bjBW131yPT8JeAk1q96yWA==',key_name='tempest-keypair-100941630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-14juu7az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:49:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=34b46dc8-281e-49bb-96ce-1494e2d7e04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG os_vif [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6d87254-0904-5b70-8873-14596072c994', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c4f4d1c-83, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c4f4d1c-83, col_values=(('qos', UUID('0411169b-32ca-4612-81f3-6769ac3460bc')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c4f4d1c-83, col_values=(('external_ids', {'iface-id': '9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b1:19', 'vm-uuid': '34b46dc8-281e-49bb-96ce-1494e2d7e04f'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:48 user nova-compute[75095]: INFO os_vif [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83')
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No VIF found with MAC fa:16:3e:e7:b1:19, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updated VIF entry in instance network info cache for port 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updating instance_info_cache with network_info: [{"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-afdca80f-3f89-4d9a-9bc0-a7568d90a997 req-4ce2270c-64b3-419c-ba1e-21bdefa7e6a4 service nova] Releasing lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] No waiting events found dispatching network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:49 user nova-compute[75095]: WARNING nova.compute.manager [req-76314865-372e-41c2-aa3f-879f0d9acc9d req-8196ea68-0d2d-47bf-814a-ce3d82ebca8c service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received unexpected event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae for instance with vm_state building and task_state spawning.
Nov 15 15:49:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:49:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Instance spawned successfully.
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] No waiting events found dispatching network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:51 user nova-compute[75095]: WARNING nova.compute.manager [req-57155a7d-f10c-417a-a838-62409ddc2b40 req-8e6aaf93-d536-49a3-9991-49a586fda820 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received unexpected event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae for instance with vm_state building and task_state spawning.
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:49:51 user nova-compute[75095]: INFO nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 15 15:49:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:49:52 user nova-compute[75095]: INFO nova.compute.manager [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Took 6.26 seconds to build instance.
Nov 15 15:49:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce7efafa-ade0-43df-9c66-43f943b5745a tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.353s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing instance network info cache due to event network-changed-2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] Acquiring lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] Acquired lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Refreshing network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:54 user nova-compute[75095]: INFO nova.compute.manager [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Terminating instance
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-unplugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] No waiting events found dispatching network-vif-unplugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4f6094c-a745-43b1-b220-c56ec66646da req-2b10bdd0-c4a4-4f49-9dcd-8ce15957cd44 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-unplugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updated VIF entry in instance network info cache for port 2922d764-7fb4-4c2d-a39e-6820cbbdd149. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating instance_info_cache with network_info: [{"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20cdfe27-4318-419b-b388-0dfd66836344 req-37f326cf-8fe4-44bd-8c75-0e2b480749d4 service nova] Releasing lock "refresh_cache-37f47320-be8b-4d7a-b8a2-228e4894f881" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:49:55 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac60b17f-c938-4031-a439-e28d8563dc75 is timed out.
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Successfully detached device vdb from instance ac60b17f-c938-4031-a439-e28d8563dc75 from the live domain config.
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHJjqPMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'e8363ab5-b525-470a-9c6b-f88cb6869a14'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:49:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4730dd-d895-4878-9eda-6ebd83883d02]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:49:55 user nova-compute[75095]: No targets found.
Nov 15 15:49:55 user nova-compute[75095]: iSNS:
Nov 15 15:49:55 user nova-compute[75095]: No targets found.
Nov 15 15:49:55 user nova-compute[75095]: STATIC:
Nov 15 15:49:55 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:49:55 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:55 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:55 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:49:55 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:55 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:55 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14
Nov 15 15:49:55 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:55 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:55 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:49:55 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:49:55 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:49:55 user nova-compute[75095]: FIRMWARE:
Nov 15 15:49:55 user nova-compute[75095]: No targets found.
Nov 15 15:49:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:49:55 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:49:55 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eaccb8-fc18-4164-bd0a-a6774a7dbd98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5449a657-1609-4e73-9c0b-4bda96a49fb2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 (non-flash)
Nov 15 15:49:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c232710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ff6142-598b-4eb5-a60c-34f93a52d3b5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abe2325-ad65-4704-9d9f-89a110f2e0cb]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Instance destroyed successfully.
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lazy-loading 'resources' on Instance uuid 37f47320-be8b-4d7a-b8a2-228e4894f881 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-218954794',display_name='tempest-TestStampPattern-server-218954794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-218954794',id=10,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOePV0PvSyZQ+E3s1+A79sn4SkAXCOhvqhh9XEA/Bsvxt0ZFTkXYR0V+T6P/kvONvn27Iy3MLr0ZwB6pAT7XnC/tiETT5+d/DtqJExjPnTuhzmG71uBUo7/g66JO5Z+Dkg==',key_name='tempest-TestStampPattern-2145058288',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:43:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08b022d733d2467d869f76f75385c807',ramdisk_id='',reservation_id='r-07s35lyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1242322391',owner_user_name='tempest-TestStampPattern-1242322391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:46:01Z,user_data=None,user_id='00d60e3be37a4596befc5bdf2b796c72',uuid=37f47320-be8b-4d7a-b8a2-228e4894f881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converting VIF {"id": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "address": "fa:16:3e:28:fb:82", "network": {"id": "4020f725-4b48-4039-9454-9741da40c159", "bridge": "br-int", "label": "tempest-TestStampPattern-58950282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08b022d733d2467d869f76f75385c807", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2922d764-7f", "ovs_interfaceid": "2922d764-7fb4-4c2d-a39e-6820cbbdd149", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_vif [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d616d8-fa26-4fd7-839f-ab812149a460]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2922d764-7f, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=364ddde5-a6e1-413e-a184-a2f5a6b86fd3) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:49:55 user nova-compute[75095]: INFO os_vif [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:fb:82,bridge_name='br-int',has_traffic_filtering=True,id=2922d764-7fb4-4c2d-a39e-6820cbbdd149,network=Network(4020f725-4b48-4039-9454-9741da40c159),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2922d764-7f')
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Deleting instance files /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881_del
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Deletion of /opt/stack/data/nova/instances/37f47320-be8b-4d7a-b8a2-228e4894f881_del complete
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e773769-0d96-40ec-b571-78434e55b733]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2077f075-5813-4e90-9969-3f811d8eb8e3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.compute.manager [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea95208-da5a-4b27-b07f-5b8d0e6fc74c]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260]
Nov 15 15:49:55 user nova-compute[75095]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14, portal: 172.16.0.220,3260] successful.
Nov 15 15:49:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8363ab5-b525-470a-9c6b-f88cb6869a14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b0b4c-7069-4a9b-897a-8a24d630ddd7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] <== disconnect_volume: return (401ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:55 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Took 0.50 seconds to deallocate network for instance.
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.665s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lazy-loading 'flavor' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:49:56 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Deleted allocations for instance 37f47320-be8b-4d7a-b8a2-228e4894f881
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d2a51c1a-6d24-4d9c-a11b-9db83226339e tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.188s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f62ca657-ba5a-4fac-8f09-7bc71f7b6fef tempest-TestStampPattern-1242322391 tempest-TestStampPattern-1242322391-project-member] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.316s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] Acquiring lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] Lock "37f47320-be8b-4d7a-b8a2-228e4894f881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] No waiting events found dispatching network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:49:56 user nova-compute[75095]: WARNING nova.compute.manager [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received unexpected event network-vif-plugged-2922d764-7fb4-4c2d-a39e-6820cbbdd149 for instance with vm_state deleted and task_state None.
Nov 15 15:49:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-9cccd398-3b70-4cf6-8e56-918b78c6379a req-7c3fe5ba-0225-4489-bc46-78bbed4d8233 service nova] [instance: 37f47320-be8b-4d7a-b8a2-228e4894f881] Received event network-vif-deleted-2922d764-7fb4-4c2d-a39e-6820cbbdd149 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-changed-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Refreshing instance network info cache due to event network-changed-f1bebef6-c544-45fe-bf9e-63dbca401df1. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] Acquiring lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] Acquired lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Refreshing network info cache for port f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updated VIF entry in instance network info cache for port f1bebef6-c544-45fe-bf9e-63dbca401df1. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updating instance_info_cache with network_info: [{"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:49:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-29cec7e6-e490-4d51-9301-4eef5ac0db9b req-2e7042a3-b504-4664-8f2b-e131bd0a6061 service nova] Releasing lock "refresh_cache-b88184a5-9c2d-4005-a46a-f595b7be5efe" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lazy-loading 'flavor' on Instance uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:50:01 user nova-compute[75095]: INFO nova.compute.claims [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Claim successful on node user
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:01 user nova-compute[75095]: INFO nova.compute.manager [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Attaching volume e685da9d-218d-4be4-9a38-18cd40a41e5a to /dev/vdb
Nov 15 15:50:01 user nova-compute[75095]: DEBUG os_brick.utils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee30ba2-9e79-4df5-85f9-cdba6418dc56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d494b3-6f07-4bb7-9af2-48343207aa08]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2fc5a-d30d-4355-9ee5-d5095a4423f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f3bc9b-ae0b-4ce5-a3d5-8b74f2da41a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:50:02 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[885570ca-b8f4-4b56-a08b-e744bc6e24f4]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.utils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updating existing volume attachment record: 60701fda-392f-4c6b-8762-6b7cdc7fc085 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:50:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:50:02 user nova-compute[75095]: INFO nova.virt.block_device [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Booting with volume c0a21996-2d45-41c9-bf1c-9abc620458aa at /dev/vda
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.utils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.policy [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2847a578-ce65-4394-9846-942b395a67f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4643e5-0ddd-45bf-bdd4-4e26bfde8256]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27465206-4aba-4b35-bcb7-c8eea28f491e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ef2200-bde7-4f93-82aa-c17562e5298b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:50:02 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60159e01-1b5a-4273-8105-3ae9d0ffc912]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG os_brick.utils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating existing volume attachment record: 7d9668e6-d9eb-415d-b998-fdd5724a69af {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:02 user nova-compute[75095]: INFO nova.compute.manager [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Terminating instance
Nov 15 15:50:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-6d85f43b-afa4-4d05-84eb-dbae988d4b83 req-00fccdc6-55d7-486f-a1e9-bf81b9e5bbc2 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-unplugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Successfully created port: e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:50:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Instance destroyed successfully.
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lazy-loading 'resources' on Instance uuid 7447d0b9-3152-49ab-8576-994810c20e29 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-67125786',display_name='tempest-ServerActionsTestOtherB-server-67125786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-67125786',id=2,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDtQJetJ6Rk20c4hPtGwdXQFMr0uCunjnCHrbE9N8X1CK4eaSxIJ0toRrH6rIs/fnj/j1wH6JsSbbR4k+6/SYSgl5MkIr31LVAAq08GjC8oywimCVbOM2FiQT1Z+vDZ4Q==',key_name='tempest-keypair-1443587891',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2038e0b00a9d431eaadfaac074eaee2d',ramdisk_id='',reservation_id='r-1pzp0gih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1639554019',owner_user_name='tempest-ServerActionsTestOtherB-1639554019-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f344bdd39e54736a7b7c7388bb8dbdb',uuid=7447d0b9-3152-49ab-8576-994810c20e29,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converting VIF {"id": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "address": "fa:16:3e:56:ec:23", "network": {"id": "1992ea2a-7f2f-4354-a190-9508ed519e02", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1581805547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2038e0b00a9d431eaadfaac074eaee2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02c9c61-08", "ovs_interfaceid": "b02c9c61-0809-40d0-be33-1d8b596c67b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_vif [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb02c9c61-08, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9a314c1-f05e-45ea-aa29-e6379c14eab6) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:03 user nova-compute[75095]: INFO os_vif [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:ec:23,bridge_name='br-int',has_traffic_filtering=True,id=b02c9c61-0809-40d0-be33-1d8b596c67b2,network=Network(1992ea2a-7f2f-4354-a190-9508ed519e02),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02c9c61-08')
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'byrQvwYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:03 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8198af99-acaf-4833-9d8c-3dbbc906679b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:50:03 user nova-compute[75095]: No targets found.
Nov 15 15:50:03 user nova-compute[75095]: iSNS:
Nov 15 15:50:03 user nova-compute[75095]: No targets found.
Nov 15 15:50:03 user nova-compute[75095]: STATIC:
Nov 15 15:50:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:50:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386
Nov 15 15:50:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:03 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:50:03 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:03 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:03 user nova-compute[75095]: FIRMWARE:
Nov 15 15:50:03 user nova-compute[75095]: No targets found.
Nov 15 15:50:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:50:03 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:50:03 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a93fc2-085c-4dcf-9096-48536e1999e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8214489-0bc1-428f-bede-80111f06ab20]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c3584c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb36e6-c1df-45a6-bbab-3bb577a25e5f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f96547-7a77-45f4-b96c-4da6aa0b07ee]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9348c9e7-3656-4493-bb84-93f5ebb4373c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6bd17b-9506-4d39-8e45-0dce7c700c1c]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1988024a-97f6-4093-bfc4-4ad7d1ec8397]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb13920c-ec5d-4cb6-b9b4-e441380468e9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260]
Nov 15 15:50:03 user nova-compute[75095]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386, portal: 172.16.0.220,3260] successful.
Nov 15 15:50:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa151bd9-2d9d-4dc2-b38a-86c933895386 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6641151-c92a-492e-8e50-2a86405c277e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] <== disconnect_volume: return (308ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:50:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Deleting instance files /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_del
Nov 15 15:50:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Deletion of /opt/stack/data/nova/instances/7447d0b9-3152-49ab-8576-994810c20e29_del complete
Nov 15 15:50:04 user nova-compute[75095]: INFO nova.compute.manager [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 15 15:50:04 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:50:04 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:50:04 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Successfully updated port: e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Acquiring lock "7447d0b9-3152-49ab-8576-994810c20e29-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Lock "7447d0b9-3152-49ab-8576-994810c20e29-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] No waiting events found dispatching network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:05 user nova-compute[75095]: WARNING nova.compute.manager [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received unexpected event network-vif-plugged-b02c9c61-0809-40d0-be33-1d8b596c67b2 for instance with vm_state active and task_state deleting.
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-changed-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Refreshing instance network info cache due to event network-changed-e180701e-156f-4c51-8282-1806863e595c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Acquiring lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:05 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Took 1.85 seconds to deallocate network for instance.
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating instance_info_cache with network_info: [{"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Instance network_info: |[{"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Acquired lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:05 user nova-compute[75095]: DEBUG nova.network.neutron [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Refreshing network info cache for port e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updated VIF entry in instance network info cache for port e180701e-156f-4c51-8282-1806863e595c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating instance_info_cache with network_info: [{"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e81fed3e-8cb1-4fd7-85c0-f4a51f131066 req-0f2b1a32-6cd8-4384-867d-83315e10fba4 service nova] Releasing lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjytEsPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:06 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:06 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:06 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:50:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfbe533-8327-4639-b439-bf6786fe864b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:50:07 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a034ce5-49c6-4be9-98a2-b6002548f959]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a] added
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3f6dd8-8342-450e-9038-c0cfd6a9bb00]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b21d5a-c2cb-4adc-9ae5-1bea437e9fcc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjytEsPV {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YjytEsPV" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4d81c-5b08-484f-97fc-05f3a450eb8f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YjytEsPV'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74c389-8647-4b91-823c-9f7add7daf7c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d8d053-cec4-44ac-85c9-06d3824672ba]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4696c5-f0b7-4837-88f0-3bef404672da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260]
Nov 15 15:50:07 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260] successful.
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a10ec-1acc-4cbe-a8f9-7bfd580b1e2a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f02b4e8-f4f3-426b-9999-161401a97ce9]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:07 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:07 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0d7ba4-a171-4f51-89c6-c91ffef445d8]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjytEsPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:50:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-b358dc61-08ee-42a5-92a3-906da18182f8 req-b83e4377-6be4-4539-8884-7e1894a11ab8 service nova] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Received event network-vif-deleted-b02c9c61-0809-40d0-be33-1d8b596c67b2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:08 user nova-compute[75095]: INFO nova.compute.manager [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] [instance: 7447d0b9-3152-49ab-8576-994810c20e29] Took 2.23 seconds to detach 1 volumes for instance.
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23432393239396335', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432393239396335', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lazy-loading 'flavor' on Instance uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:50:08 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:08 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:50:08 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:50:08 user nova-compute[75095]:   <serial>e685da9d-218d-4be4-9a38-18cd40a41e5a</serial>
Nov 15 15:50:08 user nova-compute[75095]: </disk>
Nov 15 15:50:08 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:50:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Creating image(s)
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Ensure instance console log exists: /opt/stack/data/nova/instances/6445dc31-6825-4762-9d09-b95ea70e5df3/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Start _get_guest_xml network_info=[{"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '7d9668e6-d9eb-415d-b998-fdd5724a69af', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzsXDbgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6445dc31-6825-4762-9d09-b95ea70e5df3', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0a21996-2d45-41c9-bf1c-9abc620458aa', 'serial': 'c0a21996-2d45-41c9-bf1c-9abc620458aa'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzsXDbgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:08 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b47f4d7-51ab-4350-9786-c15fa210d73e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:50:08 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[54349532-26a3-418e-abad-fa494f22ca2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa] added
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69991ffa-5538-47c6-95d5-dda27590b109]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b05068f-1030-4d56-93d6-17da71242999]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzsXDbgF {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JzsXDbgF" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742bf61-1987-4cd7-bbe1-39e9fe770c2e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JzsXDbgF'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Deleted allocations for instance 7447d0b9-3152-49ab-8576-994810c20e29
Nov 15 15:50:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b2349-8ec8-41a7-93c7-9acde92e883f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e32d0a1-ba97-4953-a305-b1ce2f9c8057]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8fc471d2-e55f-425a-be0a-063d9ff6acf6 tempest-ServerActionsTestOtherB-1639554019 tempest-ServerActionsTestOtherB-1639554019-project-member] Lock "7447d0b9-3152-49ab-8576-994810c20e29" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.974s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d64ee4-e7bf-488c-bb82-295fd725f8c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260]
Nov 15 15:50:08 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260] successful.
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] No VIF found with MAC fa:16:3e:a0:f7:dc, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f6c58-b06a-4c31-b1ea-bc86781bde23]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a337c353-1653-4b94-b970-debd9f074df2]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:08 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e608e8-d026-4a6b-b068-30cceaebbc7e]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzsXDbgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:50:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d007ef89-d91b-4448-b06c-7058db10cf03 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.157s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23835343535656664', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835343535656664', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1986202156',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV1bg4snzT91JaZJZh4Pqt8LkW+DGx6y0ocQB2kDue2rjTXnLl/rfUoJOkcIGUYcbIFKcAEnynaHJmHu4b0OdnSwJXPN2bnu/qF6gVv4wM0ZU8mzaKmt9sy5y+1Evc8UQ==',key_name='tempest-keypair-417741693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-my9ww1gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=6445dc31-6825-4762-9d09-b95ea70e5df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.objects.instance [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid 6445dc31-6825-4762-9d09-b95ea70e5df3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:50:09 user nova-compute[75095]:   <uuid>6445dc31-6825-4762-9d09-b95ea70e5df3</uuid>
Nov 15 15:50:09 user nova-compute[75095]:   <name>instance-00000019</name>
Nov 15 15:50:09 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:50:09 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:50:09 user nova-compute[75095]:   <metadata>
Nov 15 15:50:09 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:50:09 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:50:09 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1986202156</nova:name>
Nov 15 15:50:09 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:50:08</nova:creationTime>
Nov 15 15:50:09 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:50:09 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:50:09 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:50:09 user nova-compute[75095]:       <nova:owner>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 15:50:09 user nova-compute[75095]:       </nova:owner>
Nov 15 15:50:09 user nova-compute[75095]:       <nova:ports>
Nov 15 15:50:09 user nova-compute[75095]:         <nova:port uuid="e180701e-156f-4c51-8282-1806863e595c">
Nov 15 15:50:09 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:50:09 user nova-compute[75095]:         </nova:port>
Nov 15 15:50:09 user nova-compute[75095]:       </nova:ports>
Nov 15 15:50:09 user nova-compute[75095]:     </nova:instance>
Nov 15 15:50:09 user nova-compute[75095]:   </metadata>
Nov 15 15:50:09 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:50:09 user nova-compute[75095]:     <system>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="serial">6445dc31-6825-4762-9d09-b95ea70e5df3</entry>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="uuid">6445dc31-6825-4762-9d09-b95ea70e5df3</entry>
Nov 15 15:50:09 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:50:09 user nova-compute[75095]:     </system>
Nov 15 15:50:09 user nova-compute[75095]:   </sysinfo>
Nov 15 15:50:09 user nova-compute[75095]:   <os>
Nov 15 15:50:09 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:50:09 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:50:09 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:50:09 user nova-compute[75095]:   </os>
Nov 15 15:50:09 user nova-compute[75095]:   <features>
Nov 15 15:50:09 user nova-compute[75095]:     <acpi/>
Nov 15 15:50:09 user nova-compute[75095]:     <apic/>
Nov 15 15:50:09 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:50:09 user nova-compute[75095]:   </features>
Nov 15 15:50:09 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:50:09 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:50:09 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:50:09 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:50:09 user nova-compute[75095]:   </clock>
Nov 15 15:50:09 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:50:09 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:50:09 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:50:09 user nova-compute[75095]:   </cpu>
Nov 15 15:50:09 user nova-compute[75095]:   <devices>
Nov 15 15:50:09 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:50:09 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:09 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:50:09 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:50:09 user nova-compute[75095]:       <serial>c0a21996-2d45-41c9-bf1c-9abc620458aa</serial>
Nov 15 15:50:09 user nova-compute[75095]:     </disk>
Nov 15 15:50:09 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:50:09 user nova-compute[75095]:       <mac address="fa:16:3e:ce:cd:81"/>
Nov 15 15:50:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:09 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:50:09 user nova-compute[75095]:       <target dev="tape180701e-15"/>
Nov 15 15:50:09 user nova-compute[75095]:     </interface>
Nov 15 15:50:09 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:50:09 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/6445dc31-6825-4762-9d09-b95ea70e5df3/console.log" append="off"/>
Nov 15 15:50:09 user nova-compute[75095]:     </serial>
Nov 15 15:50:09 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:50:09 user nova-compute[75095]:     <video>
Nov 15 15:50:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:09 user nova-compute[75095]:     </video>
Nov 15 15:50:09 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:50:09 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:50:09 user nova-compute[75095]:     </rng>
Nov 15 15:50:09 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:50:09 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:50:09 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:50:09 user nova-compute[75095]:     </memballoon>
Nov 15 15:50:09 user nova-compute[75095]:   </devices>
Nov 15 15:50:09 user nova-compute[75095]: </domain>
Nov 15 15:50:09 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1986202156',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV1bg4snzT91JaZJZh4Pqt8LkW+DGx6y0ocQB2kDue2rjTXnLl/rfUoJOkcIGUYcbIFKcAEnynaHJmHu4b0OdnSwJXPN2bnu/qF6gVv4wM0ZU8mzaKmt9sy5y+1Evc8UQ==',key_name='tempest-keypair-417741693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-my9ww1gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=6445dc31-6825-4762-9d09-b95ea70e5df3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG os_vif [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c09274f-4cab-5602-b98a-5e36c1d6e89c', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape180701e-15, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape180701e-15, col_values=(('qos', UUID('d0f8ef8d-ba57-4b6f-b935-79fe7106459a')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape180701e-15, col_values=(('external_ids', {'iface-id': 'e180701e-156f-4c51-8282-1806863e595c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:cd:81', 'vm-uuid': '6445dc31-6825-4762-9d09-b95ea70e5df3'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:09 user nova-compute[75095]: INFO os_vif [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15')
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:ce:cd:81, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:10 user nova-compute[75095]: INFO nova.compute.manager [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Detaching volume e685da9d-218d-4be4-9a38-18cd40a41e5a
Nov 15 15:50:10 user nova-compute[75095]: INFO nova.virt.block_device [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Attempting to driver detach volume e685da9d-218d-4be4-9a38-18cd40a41e5a from mountpoint /dev/vdb
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Attempting to detach device vdb from instance b88184a5-9c2d-4005-a46a-f595b7be5efe from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:50:10 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:10 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:50:10 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:50:10 user nova-compute[75095]:   <serial>e685da9d-218d-4be4-9a38-18cd40a41e5a</serial>
Nov 15 15:50:10 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:50:10 user nova-compute[75095]: </disk>
Nov 15 15:50:10 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:50:10 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Successfully detached device vdb from instance b88184a5-9c2d-4005-a46a-f595b7be5efe from the persistent domain config.
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b88184a5-9c2d-4005-a46a-f595b7be5efe from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:50:10 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:10 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:50:10 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:50:10 user nova-compute[75095]:   <serial>e685da9d-218d-4be4-9a38-18cd40a41e5a</serial>
Nov 15 15:50:10 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:50:10 user nova-compute[75095]: </disk>
Nov 15 15:50:10 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:50:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:50:11 user nova-compute[75095]: INFO nova.compute.manager [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Rescuing
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] No waiting events found dispatching network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:11 user nova-compute[75095]: WARNING nova.compute.manager [req-5eb0aa93-567c-47da-931c-f43fd67a2442 req-052b37d3-a54b-455a-a639-86f58186db41 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received unexpected event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c for instance with vm_state building and task_state spawning.
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:12 user nova-compute[75095]: WARNING nova.compute.manager [req-4163e68b-f9ac-4ba6-a5a9-681cd4245f0d req-3ecca056-9500-42c2-8ebb-a4c655a303be service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state rescuing.
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance destroyed successfully.
Nov 15 15:50:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Attempting a stable device rescue
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:50:12 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Creating image(s)
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'trusted_certs' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "e4d40dceec02886c99df7994bd4f385a540a92f6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "e4d40dceec02886c99df7994bd4f385a540a92f6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:12 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.part --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.virt.images [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] 755289e6-e667-4cbd-b978-b3b2ab5098d9 was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.part /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] No waiting events found dispatching network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:13 user nova-compute[75095]: WARNING nova.compute.manager [req-64e790ed-6675-4544-8fea-dc1cca2367e3 req-d739f86c-c8cd-4492-9682-7c312fd7f6a7 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received unexpected event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c for instance with vm_state building and task_state spawning.
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:50:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:50:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Instance spawned successfully.
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.part /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.converted" returned: 0 in 0.388s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:50:14 user nova-compute[75095]: INFO nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:14 user nova-compute[75095]: WARNING nova.compute.manager [req-d4161d61-88b5-4adc-ba60-0091fe788401 req-a94c5b1a-b09b-47ff-8f16-2db8ff857025 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state rescuing.
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:14 user nova-compute[75095]: INFO nova.compute.manager [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Took 12.57 seconds to build instance.
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-396fc754-1e4c-4a8b-8e81-a4ae6f6a40e3 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.756s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "e4d40dceec02886c99df7994bd4f385a540a92f6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.716s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "e4d40dceec02886c99df7994bd4f385a540a92f6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "e4d40dceec02886c99df7994bd4f385a540a92f6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6,backing_fmt=raw /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6,backing_fmt=raw /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue" returned: 0 in 0.046s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "e4d40dceec02886c99df7994bd4f385a540a92f6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'migration_context' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<82639568-19ea-4e63-a23f-c70ead2b2ca6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start _get_guest_xml network_info=[{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:87:51:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '755289e6-e667-4cbd-b978-b3b2ab5098d9', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '9069ce05-0aba-49fc-90f6-95e81435b202', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '82639568-19ea-4e63-a23f-c70ead2b2ca6', 'attached_at': '', 'detached_at': '', 'volume_id': '043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'serial': '043b0d1f-799c-41db-9daa-4cbb00e1ac91'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<82639568-19ea-4e63-a23f-c70ead2b2ca6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'numa_topology' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<82639568-19ea-4e63-a23f-c70ead2b2ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:50:14 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:14 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'vcpu_model' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<82639568-19ea-4e63-a23f-c70ead2b2ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:14 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8354a12-2b78-4a3f-82c0-fc10c21423f6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = PamiElgp\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 15:50:14 user nova-compute[75095]: node.name = iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:50:14 user nova-compute[75095]: node.tpgt = -1
Nov 15 15:50:14 user nova-compute[75095]: node.startup = automatic
Nov 15 15:50:14 user nova-compute[75095]: node.leading_login = No
Nov 15 15:50:14 user nova-compute[75095]: iface.iscsi_ifacename = default
Nov 15 15:50:14 user nova-compute[75095]: iface.net_ifacename = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.ipaddress = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.prefix_len = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.hwaddress = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.transport_name = tcp
Nov 15 15:50:14 user nova-compute[75095]: iface.initiatorname = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.vlan_id = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.vlan_priority = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.vlan_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.iface_num = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.mtu = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.port = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.bootproto = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.subnet_mask = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.gateway = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_alt_client_id = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_dns = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_learn_iqn = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_vendor_id_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_vendor_id = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.dhcp_slp_da = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.fragmentation = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.gratuitous_arp = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.incoming_forwarding = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.tos_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.tos = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.ttl = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.delayed_ack = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.tcp_nagle = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.tcp_wsf_state = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.tcp_wsf = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.tcp_timer_scale = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.tcp_timestamp = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.redirect = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.def_task_mgmt_timeout = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.header_digest = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.data_digest = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.immediate_data = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.initial_r2t = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.data_seq_inorder = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.data_pdu_inorder = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.erl = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.max_receive_data_len = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.first_burst_len = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.max_outstanding_r2t = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.max_burst_len = 0
Nov 15 15:50:14 user nova-compute[75095]: iface.chap_auth = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.bidi_chap = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.strict_login_compliance = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.discovery_auth = <empty>
Nov 15 15:50:14 user nova-compute[75095]: iface.discovery_logout = <empty>
Nov 15 15:50:14 user nova-compute[75095]: node.discovery_address = <empty>
Nov 15 15:50:14 user nova-compute[75095]: node.discovery_port = 0
Nov 15 15:50:14 user nova-compute[75095]: node.discovery_type = static
Nov 15 15:50:14 user nova-compute[75095]: node.session.initial_cmdsn = 0
Nov 15 15:50:14 user nova-compute[75095]: node.session.initial_login_retry_max = 8
Nov 15 15:50:14 user nova-compute[75095]: node.session.xmit_thread_priority = -20
Nov 15 15:50:14 user nova-compute[75095]: node.session.cmds_max = 128
Nov 15 15:50:14 user nova-compute[75095]: node.session.queue_depth = 32
Nov 15 15:50:14 user nova-compute[75095]: node.session.nr_sessions = 1
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.authmethod = CHAP
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.username = PamiElgp
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.password = ***
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.username_in = <empty>
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.password_in = <empty>
Nov 15 15:50:14 user nova-compute[75095]: node.session.auth.chap_algs = MD5
Nov 15 15:50:14 user nova-compute[75095]: node.session.timeo.replacement_timeout = 120
Nov 15 15:50:14 user nova-compute[75095]: node.session.err_timeo.abort_timeout = 15
Nov 15 15:50:14 user nova-compute[75095]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 15:50:14 user nova-compute[75095]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 15:50:14 user nova-compute[75095]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.FastAbort = Yes
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.InitialR2T = No
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.ImmediateData = Yes
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.MaxConnections = 1
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 15:50:14 user nova-compute[75095]: node.session.iscsi.ERL = 0
Nov 15 15:50:14 user nova-compute[75095]: node.session.scan = manual
Nov 15 15:50:14 user nova-compute[75095]: node.session.reopen_max = 0
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].address = 172.16.0.220
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].port = 3260
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].startup = manual
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].tcp.window_size = 524288
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].tcp.type_of_service = 0
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].timeo.logout_timeout = 15
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].timeo.login_timeout = 15
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].timeo.auth_timeout = 45
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.DataDigest = None
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.IFMarker = No
Nov 15 15:50:14 user nova-compute[75095]: node.conn[0].iscsi.OFMarker = No
Nov 15 15:50:14 user nova-compute[75095]: # END RECORD
Nov 15 15:50:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa8cd69-fc4a-4a44-896c-ca7452907543]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ed9519-e14f-4937-962d-69eb3e07c4d8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PamiElgp {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PamiElgp" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dec1d1-abcf-4d10-b05e-7e21e78c512d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PamiElgp'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d45322a-c772-4727-936b-26bc7e130d9a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[070466f8-35f0-498a-a946-79d498650453]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] HCTL ('37', '0', '0', 0) found on session 24 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e228707-b34a-41e9-9ffa-94b0c2a8016a]: (4, ('0 0 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching for a device in session 24 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== connect_volume: return (173ms) {'type': 'block', 'scsi_wwn': '26433343830636166', 'path': '/dev/sdf'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433343830636166', 'path': '/dev/sdf'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-964997264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-964997264',id=21,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:48:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-86sje3pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:48:42Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=82639568-19ea-4e63-a23f-c70ead2b2ca6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:87:51:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:87:51:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.objects.base [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<82639568-19ea-4e63-a23f-c70ead2b2ca6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:50:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:50:14 user nova-compute[75095]:   <uuid>82639568-19ea-4e63-a23f-c70ead2b2ca6</uuid>
Nov 15 15:50:14 user nova-compute[75095]:   <name>instance-00000015</name>
Nov 15 15:50:14 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:50:14 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:50:14 user nova-compute[75095]:   <metadata>
Nov 15 15:50:14 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:50:14 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-964997264</nova:name>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:50:14</nova:creationTime>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:50:14 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:50:14 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:owner>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:50:14 user nova-compute[75095]:       </nova:owner>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:50:14 user nova-compute[75095]:       <nova:ports>
Nov 15 15:50:14 user nova-compute[75095]:         <nova:port uuid="d2faa453-bbaa-47be-b0ed-78821863719b">
Nov 15 15:50:14 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:50:14 user nova-compute[75095]:         </nova:port>
Nov 15 15:50:14 user nova-compute[75095]:       </nova:ports>
Nov 15 15:50:14 user nova-compute[75095]:     </nova:instance>
Nov 15 15:50:14 user nova-compute[75095]:   </metadata>
Nov 15 15:50:14 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:50:14 user nova-compute[75095]:     <system>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="serial">82639568-19ea-4e63-a23f-c70ead2b2ca6</entry>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="uuid">82639568-19ea-4e63-a23f-c70ead2b2ca6</entry>
Nov 15 15:50:14 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:50:14 user nova-compute[75095]:     </system>
Nov 15 15:50:14 user nova-compute[75095]:   </sysinfo>
Nov 15 15:50:14 user nova-compute[75095]:   <os>
Nov 15 15:50:14 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:50:14 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:50:14 user nova-compute[75095]:   </os>
Nov 15 15:50:14 user nova-compute[75095]:   <features>
Nov 15 15:50:14 user nova-compute[75095]:     <acpi/>
Nov 15 15:50:14 user nova-compute[75095]:     <apic/>
Nov 15 15:50:14 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:50:14 user nova-compute[75095]:   </features>
Nov 15 15:50:14 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:50:14 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:50:14 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:50:14 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:50:14 user nova-compute[75095]:   </clock>
Nov 15 15:50:14 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:50:14 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:50:14 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:50:14 user nova-compute[75095]:   </cpu>
Nov 15 15:50:14 user nova-compute[75095]:   <devices>
Nov 15 15:50:14 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:50:14 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:14 user nova-compute[75095]:       <source dev="/dev/sdf"/>
Nov 15 15:50:14 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:50:14 user nova-compute[75095]:       <serial>043b0d1f-799c-41db-9daa-4cbb00e1ac91</serial>
Nov 15 15:50:14 user nova-compute[75095]:     </disk>
Nov 15 15:50:14 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:50:14 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:50:14 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue"/>
Nov 15 15:50:14 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:50:14 user nova-compute[75095]:       <boot order="1"/>
Nov 15 15:50:14 user nova-compute[75095]:     </disk>
Nov 15 15:50:14 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:50:14 user nova-compute[75095]:       <mac address="fa:16:3e:87:51:f1"/>
Nov 15 15:50:14 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:14 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:50:14 user nova-compute[75095]:       <target dev="tapd2faa453-bb"/>
Nov 15 15:50:14 user nova-compute[75095]:     </interface>
Nov 15 15:50:14 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:50:14 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/console.log" append="off"/>
Nov 15 15:50:14 user nova-compute[75095]:     </serial>
Nov 15 15:50:14 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:50:14 user nova-compute[75095]:     <video>
Nov 15 15:50:14 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:14 user nova-compute[75095]:     </video>
Nov 15 15:50:14 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:50:14 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:50:14 user nova-compute[75095]:     </rng>
Nov 15 15:50:14 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:50:14 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:50:14 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:50:14 user nova-compute[75095]:     </memballoon>
Nov 15 15:50:14 user nova-compute[75095]:   </devices>
Nov 15 15:50:14 user nova-compute[75095]: </domain>
Nov 15 15:50:14 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:50:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance destroyed successfully.
Nov 15 15:50:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:87:51:f1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG nova.compute.manager [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG nova.compute.manager [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:16 user nova-compute[75095]: WARNING nova.compute.manager [req-b2180d5f-e060-46a0-aaa6-5b00beef04c1 req-fc0f06cc-d8fe-45f3-a7a7-7587bd791149 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state rescuing.
Nov 15 15:50:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:17 user nova-compute[75095]: INFO nova.compute.manager [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Terminating instance
Nov 15 15:50:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-unplugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] No waiting events found dispatching network-vif-unplugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-cbb852ec-0a53-4530-ba61-6f4d7c174441 req-a18cd394-cd2b-4e39-9a54-1d9a1a7e94a1 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-unplugged-f554df74-938a-4593-b082-70f67f0e86ca for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:18 user nova-compute[75095]: WARNING nova.compute.manager [req-4dee327c-8c4f-454c-a92c-36c3fccfaf97 req-556e0df8-d4c0-4ed6-94ad-556043d7e6fb service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state rescuing.
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Instance destroyed successfully.
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.objects.instance [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lazy-loading 'resources' on Instance uuid 5e7f493b-b14d-43bc-8342-fdbc59562923 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-146368793',display_name='tempest-VolumesNegativeTest-instance-146368793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-146368793',id=22,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:48:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23fd461bd6614d7f9ee696faa86b6b79',ramdisk_id='',reservation_id='r-x8wmyw80',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-625078258',owner_user_name='tempest-VolumesNegativeTest-625078258-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:48:39Z,user_data=None,user_id='ae1f28bb14ba41d583c1b79697cd0c5c',uuid=5e7f493b-b14d-43bc-8342-fdbc59562923,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converting VIF {"id": "f554df74-938a-4593-b082-70f67f0e86ca", "address": "fa:16:3e:bd:f0:9b", "network": {"id": "49bcc6af-4cd3-469d-acae-65972608b54d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "2132dec5efbf41c8ac7c9ff52a64cc92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf554df74-93", "ovs_interfaceid": "f554df74-938a-4593-b082-70f67f0e86ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG os_vif [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf554df74-93, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4896609-06d0-4582-8cba-c49cae0c378f) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0cc6385d-bb62-4f4a-bc50-ee7fe8dbd0dc tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:18 user nova-compute[75095]: INFO os_vif [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:f0:9b,bridge_name='br-int',has_traffic_filtering=True,id=f554df74-938a-4593-b082-70f67f0e86ca,network=Network(49bcc6af-4cd3-469d-acae-65972608b54d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf554df74-93')
Nov 15 15:50:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Deleting instance files /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923_del
Nov 15 15:50:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Deletion of /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923_del complete
Nov 15 15:50:18 user nova-compute[75095]: INFO nova.compute.manager [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json" returned: 1 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk --force-share --output=json' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:50:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000016, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/5e7f493b-b14d-43bc-8342-fdbc59562923/disk
Nov 15 15:50:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=24.456382751464844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:19 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Took 0.91 seconds to deallocate network for instance.
Nov 15 15:50:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ac60b17f-c938-4031-a439-e28d8563dc75 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b88184a5-9c2d-4005-a46a-f595b7be5efe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 5e7f493b-b14d-43bc-8342-fdbc59562923 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance a552ab2a-2123-45c2-914f-16e558f12af4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:50:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.388s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] Acquiring lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] No waiting events found dispatching network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:20 user nova-compute[75095]: WARNING nova.compute.manager [req-49573a8c-347c-4950-9bea-35378edeeb4c req-e8af71a5-71e4-45ee-82db-a223d786a10d service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received unexpected event network-vif-plugged-f554df74-938a-4593-b082-70f67f0e86ca for instance with vm_state deleted and task_state None.
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:20 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Deleted allocations for instance 5e7f493b-b14d-43bc-8342-fdbc59562923
Nov 15 15:50:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-7b2ff02d-b065-44ba-9067-eb7f31604ee1 req-5152a511-4dfa-4d80-9b6e-24042dfcc7b2 service nova] [instance: 5e7f493b-b14d-43bc-8342-fdbc59562923] Received event network-vif-deleted-f554df74-938a-4593-b082-70f67f0e86ca {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-31300e0d-aa12-4e67-8176-f66796f4daf9 tempest-VolumesNegativeTest-625078258 tempest-VolumesNegativeTest-625078258-project-member] Lock "5e7f493b-b14d-43bc-8342-fdbc59562923" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.764s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:50:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:50:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:24 user nova-compute[75095]: INFO nova.compute.manager [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Terminating instance
Nov 15 15:50:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:50:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-unplugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] No waiting events found dispatching network-vif-unplugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-d64df504-e18c-456f-a5df-d10a1c1c446e req-bf13a48c-3c0e-4a44-8718-9260273cea0d service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-unplugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:50:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Instance destroyed successfully.
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.objects.instance [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lazy-loading 'resources' on Instance uuid ac60b17f-c938-4031-a439-e28d8563dc75 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-175315261',display_name='tempest-TestVolumeSwap-server-175315261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-175315261',id=17,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMd2GKBnOW4kJjTDDoO26RAlmtRtih5DtjoOaW7ixZr3py37PGzGvsPhCfUpgP+ugIdM0ySuGTioW22wvwN2/vjITd3gaFvFJaJ8tLD/qttN5Fgmztob2uxbeh1Int15g==',key_name='tempest-keypair-672407940',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:47:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3aa49b704e264842bcbd046383a6deda',ramdisk_id='',reservation_id='r-245dxl1n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1791544710',owner_user_name='tempest-TestVolumeSwap-1791544710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9c27fe2e0e74192975c7544bf9bda40',uuid=ac60b17f-c938-4031-a439-e28d8563dc75,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converting VIF {"id": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "address": "fa:16:3e:f4:71:3e", "network": {"id": "2fd74a23-21c0-452a-b791-5bdea3f87413", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1942229627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3aa49b704e264842bcbd046383a6deda", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f3ba2b5-c3", "ovs_interfaceid": "0f3ba2b5-c398-451e-a695-7dbcaf3c3363", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG os_vif [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f3ba2b5-c3, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=378509e1-c4b5-4c7b-8fb5-a24c03c0f438) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:25 user nova-compute[75095]: INFO os_vif [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:3e,bridge_name='br-int',has_traffic_filtering=True,id=0f3ba2b5-c398-451e-a695-7dbcaf3c3363,network=Network(2fd74a23-21c0-452a-b791-5bdea3f87413),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f3ba2b5-c3')
Nov 15 15:50:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Deleting instance files /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75_del
Nov 15 15:50:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Deletion of /opt/stack/data/nova/instances/ac60b17f-c938-4031-a439-e28d8563dc75_del complete
Nov 15 15:50:25 user nova-compute[75095]: INFO nova.compute.manager [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 15:50:25 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:50:25 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:50:26 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:26 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Took 0.86 seconds to deallocate network for instance.
Nov 15 15:50:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:27 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Deleted allocations for instance ac60b17f-c938-4031-a439-e28d8563dc75
Nov 15 15:50:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-29ff8aaa-57d8-459d-89d3-ec4fd2bfd8ae tempest-TestVolumeSwap-1791544710 tempest-TestVolumeSwap-1791544710-project-member] Lock "ac60b17f-c938-4031-a439-e28d8563dc75" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] Acquiring lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] Lock "ac60b17f-c938-4031-a439-e28d8563dc75-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] No waiting events found dispatching network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:27 user nova-compute[75095]: WARNING nova.compute.manager [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received unexpected event network-vif-plugged-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 for instance with vm_state deleted and task_state None.
Nov 15 15:50:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-8d1a6e15-18c3-4ea7-8447-6ca82bc48c06 req-980a214f-d147-4f77-be77-925a09ac7efe service nova] [instance: ac60b17f-c938-4031-a439-e28d8563dc75] Received event network-vif-deleted-0f3ba2b5-c398-451e-a695-7dbcaf3c3363 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:30 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b88184a5-9c2d-4005-a46a-f595b7be5efe is timed out.
Nov 15 15:50:30 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Successfully detached device vdb from instance b88184a5-9c2d-4005-a46a-f595b7be5efe from the live domain config.
Nov 15 15:50:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YjytEsPV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:50:30 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28290f9-8696-4c08-8122-22e70e61423d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:50:30 user nova-compute[75095]: No targets found.
Nov 15 15:50:30 user nova-compute[75095]: iSNS:
Nov 15 15:50:30 user nova-compute[75095]: No targets found.
Nov 15 15:50:30 user nova-compute[75095]: STATIC:
Nov 15 15:50:30 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:50:30 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:30 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:30 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:50:30 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:30 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:30 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:50:30 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:30 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:30 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a
Nov 15 15:50:30 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:50:30 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:50:30 user nova-compute[75095]: FIRMWARE:
Nov 15 15:50:30 user nova-compute[75095]: No targets found.
Nov 15 15:50:30 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:50:30 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:50:30 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651edb4-7768-4901-b213-2ef796cadc1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da33bfb9-c71d-4148-8883-ef3b90cffd89]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a (non-flash)
Nov 15 15:50:31 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:50:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1ff640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[15535d8e-bf23-4f24-89db-4c318865157c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5866dda0-66fb-4a9d-9a14-521f87d6c54c]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b789b-40ac-4883-930e-7af1083a3138]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce4f814-7b67-4a96-b717-6f20a787babb]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[805f1539-1e62-407c-8beb-18814b1227d4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5476becc-3265-4890-89dd-33c9f4058479]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260]
Nov 15 15:50:31 user nova-compute[75095]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a, portal: 172.16.0.220,3260] successful.
Nov 15 15:50:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e685da9d-218d-4be4-9a38-18cd40a41e5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bd20ef-f06e-44f9-84fd-618f335fc2ae]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] <== disconnect_volume: return (301ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:50:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:50:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lazy-loading 'flavor' on Instance uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-30222b50-4640-48cf-9e2d-58e035c7421b tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.018s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:50:37 user nova-compute[75095]: INFO nova.compute.claims [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Claim successful on node user
Nov 15 15:50:37 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:50:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.policy [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b373d886288b4895a2b41b26063db3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf29264b1f4e38982c483eed3bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:50:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Creating image(s)
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:50:38 user nova-compute[75095]: INFO nova.compute.claims [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Claim successful on node user
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk 1073741824" returned: 0 in 0.052s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Successfully created port: 24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Cannot resize image /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Ensure instance console log exists: /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:50:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.policy [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b373d886288b4895a2b41b26063db3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf29264b1f4e38982c483eed3bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:50:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Creating image(s)
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk 1073741824" returned: 0 in 0.046s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Successfully updated port: 24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Cannot resize image /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Ensure instance console log exists: /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-changed-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Refreshing instance network info cache due to event network-changed-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Successfully created port: cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.neutron [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance network_info: |[{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.neutron [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Refreshing network info cache for port 24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start _get_guest_xml network_info=[{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:50:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1894338793',display_name='tempest-ServerRescueNegativeTestJSON-server-1894338793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1894338793',id=26,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-wzgee21s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:38Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=aad21504-a43c-4451-8b5b-90ac2a8fc3a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.objects.instance [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:50:40 user nova-compute[75095]:   <uuid>aad21504-a43c-4451-8b5b-90ac2a8fc3a5</uuid>
Nov 15 15:50:40 user nova-compute[75095]:   <name>instance-0000001a</name>
Nov 15 15:50:40 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:50:40 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:50:40 user nova-compute[75095]:   <metadata>
Nov 15 15:50:40 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:50:40 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1894338793</nova:name>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:50:40</nova:creationTime>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:50:40 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:50:40 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:owner>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 15:50:40 user nova-compute[75095]:       </nova:owner>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:50:40 user nova-compute[75095]:       <nova:ports>
Nov 15 15:50:40 user nova-compute[75095]:         <nova:port uuid="24e5dc9c-6245-497d-8a25-1b5f0f24fbb2">
Nov 15 15:50:40 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:50:40 user nova-compute[75095]:         </nova:port>
Nov 15 15:50:40 user nova-compute[75095]:       </nova:ports>
Nov 15 15:50:40 user nova-compute[75095]:     </nova:instance>
Nov 15 15:50:40 user nova-compute[75095]:   </metadata>
Nov 15 15:50:40 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:50:40 user nova-compute[75095]:     <system>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="serial">aad21504-a43c-4451-8b5b-90ac2a8fc3a5</entry>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="uuid">aad21504-a43c-4451-8b5b-90ac2a8fc3a5</entry>
Nov 15 15:50:40 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:50:40 user nova-compute[75095]:     </system>
Nov 15 15:50:40 user nova-compute[75095]:   </sysinfo>
Nov 15 15:50:40 user nova-compute[75095]:   <os>
Nov 15 15:50:40 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:50:40 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:50:40 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:50:40 user nova-compute[75095]:   </os>
Nov 15 15:50:40 user nova-compute[75095]:   <features>
Nov 15 15:50:40 user nova-compute[75095]:     <acpi/>
Nov 15 15:50:40 user nova-compute[75095]:     <apic/>
Nov 15 15:50:40 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:50:40 user nova-compute[75095]:   </features>
Nov 15 15:50:40 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:50:40 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:50:40 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:50:40 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:50:40 user nova-compute[75095]:   </clock>
Nov 15 15:50:40 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:50:40 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:50:40 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:50:40 user nova-compute[75095]:   </cpu>
Nov 15 15:50:40 user nova-compute[75095]:   <devices>
Nov 15 15:50:40 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:50:40 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:50:40 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk"/>
Nov 15 15:50:40 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:50:40 user nova-compute[75095]:     </disk>
Nov 15 15:50:40 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:50:40 user nova-compute[75095]:       <mac address="fa:16:3e:64:3a:ce"/>
Nov 15 15:50:40 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:40 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:50:40 user nova-compute[75095]:       <target dev="tap24e5dc9c-62"/>
Nov 15 15:50:40 user nova-compute[75095]:     </interface>
Nov 15 15:50:40 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:50:40 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/console.log" append="off"/>
Nov 15 15:50:40 user nova-compute[75095]:     </serial>
Nov 15 15:50:40 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:50:40 user nova-compute[75095]:     <video>
Nov 15 15:50:40 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:40 user nova-compute[75095]:     </video>
Nov 15 15:50:40 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:50:40 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:50:40 user nova-compute[75095]:     </rng>
Nov 15 15:50:40 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:50:40 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:50:40 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:50:40 user nova-compute[75095]:     </memballoon>
Nov 15 15:50:40 user nova-compute[75095]:   </devices>
Nov 15 15:50:40 user nova-compute[75095]: </domain>
Nov 15 15:50:40 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1894338793',display_name='tempest-ServerRescueNegativeTestJSON-server-1894338793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1894338793',id=26,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-wzgee21s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:38Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=aad21504-a43c-4451-8b5b-90ac2a8fc3a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG os_vif [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eca6163c-c261-50ad-8cda-ba44787ec686', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e5dc9c-62, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24e5dc9c-62, col_values=(('qos', UUID('203f5e3a-420a-44ae-8473-44f5e04afe06')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24e5dc9c-62, col_values=(('external_ids', {'iface-id': '24e5dc9c-6245-497d-8a25-1b5f0f24fbb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:3a:ce', 'vm-uuid': 'aad21504-a43c-4451-8b5b-90ac2a8fc3a5'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:40 user nova-compute[75095]: INFO os_vif [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62')
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:64:3a:ce, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updated VIF entry in instance network info cache for port 24e5dc9c-6245-497d-8a25-1b5f0f24fbb2. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Successfully updated port: cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b01f382b-8e23-4542-8632-e1223a626ec1 req-d4235ecf-30ac-4e27-8035-6e818ab214aa service nova] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance network_info: |[{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start _get_guest_xml network_info=[{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:50:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-changed-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Refreshing instance network info cache due to event network-changed-cc369ea8-4685-43ea-b690-07b025a48169. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] Acquiring lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] Acquired lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Refreshing network info cache for port cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-486487011',display_name='tempest-ServerRescueNegativeTestJSON-server-486487011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-486487011',id=27,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-3chxgaqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:39Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:50:42 user nova-compute[75095]:   <uuid>bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</uuid>
Nov 15 15:50:42 user nova-compute[75095]:   <name>instance-0000001b</name>
Nov 15 15:50:42 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:50:42 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:50:42 user nova-compute[75095]:   <metadata>
Nov 15 15:50:42 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:50:42 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-486487011</nova:name>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:50:42</nova:creationTime>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:50:42 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:50:42 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:owner>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 15:50:42 user nova-compute[75095]:       </nova:owner>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:50:42 user nova-compute[75095]:       <nova:ports>
Nov 15 15:50:42 user nova-compute[75095]:         <nova:port uuid="cc369ea8-4685-43ea-b690-07b025a48169">
Nov 15 15:50:42 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:50:42 user nova-compute[75095]:         </nova:port>
Nov 15 15:50:42 user nova-compute[75095]:       </nova:ports>
Nov 15 15:50:42 user nova-compute[75095]:     </nova:instance>
Nov 15 15:50:42 user nova-compute[75095]:   </metadata>
Nov 15 15:50:42 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:50:42 user nova-compute[75095]:     <system>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="serial">bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</entry>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="uuid">bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</entry>
Nov 15 15:50:42 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:50:42 user nova-compute[75095]:     </system>
Nov 15 15:50:42 user nova-compute[75095]:   </sysinfo>
Nov 15 15:50:42 user nova-compute[75095]:   <os>
Nov 15 15:50:42 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:50:42 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:50:42 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:50:42 user nova-compute[75095]:   </os>
Nov 15 15:50:42 user nova-compute[75095]:   <features>
Nov 15 15:50:42 user nova-compute[75095]:     <acpi/>
Nov 15 15:50:42 user nova-compute[75095]:     <apic/>
Nov 15 15:50:42 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:50:42 user nova-compute[75095]:   </features>
Nov 15 15:50:42 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:50:42 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:50:42 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:50:42 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:50:42 user nova-compute[75095]:   </clock>
Nov 15 15:50:42 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:50:42 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:50:42 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:50:42 user nova-compute[75095]:   </cpu>
Nov 15 15:50:42 user nova-compute[75095]:   <devices>
Nov 15 15:50:42 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:50:42 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:50:42 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk"/>
Nov 15 15:50:42 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:50:42 user nova-compute[75095]:     </disk>
Nov 15 15:50:42 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:50:42 user nova-compute[75095]:       <mac address="fa:16:3e:26:93:5e"/>
Nov 15 15:50:42 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:42 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:50:42 user nova-compute[75095]:       <target dev="tapcc369ea8-46"/>
Nov 15 15:50:42 user nova-compute[75095]:     </interface>
Nov 15 15:50:42 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:50:42 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/console.log" append="off"/>
Nov 15 15:50:42 user nova-compute[75095]:     </serial>
Nov 15 15:50:42 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:50:42 user nova-compute[75095]:     <video>
Nov 15 15:50:42 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:50:42 user nova-compute[75095]:     </video>
Nov 15 15:50:42 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:50:42 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:50:42 user nova-compute[75095]:     </rng>
Nov 15 15:50:42 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:50:42 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:50:42 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:50:42 user nova-compute[75095]:     </memballoon>
Nov 15 15:50:42 user nova-compute[75095]:   </devices>
Nov 15 15:50:42 user nova-compute[75095]: </domain>
Nov 15 15:50:42 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-486487011',display_name='tempest-ServerRescueNegativeTestJSON-server-486487011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-486487011',id=27,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-3chxgaqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:39Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG os_vif [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28d68639-7077-5375-8c80-805b84bfaf91', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc369ea8-46, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc369ea8-46, col_values=(('qos', UUID('54f76fa4-a3b8-4edf-974d-9cc352a428ae')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc369ea8-46, col_values=(('external_ids', {'iface-id': 'cc369ea8-4685-43ea-b690-07b025a48169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:93:5e', 'vm-uuid': 'bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: INFO os_vif [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46')
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:26:93:5e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updated VIF entry in instance network info cache for port cc369ea8-4685-43ea-b690-07b025a48169. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1dea235c-2d69-4c23-ba23-78e6bb3d9908 req-f19cfcaf-ff22-45f7-af01-df45d391721e service nova] Releasing lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:44 user nova-compute[75095]: WARNING nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state building and task_state spawning.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:44 user nova-compute[75095]: WARNING nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state building and task_state spawning.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:44 user nova-compute[75095]: WARNING nova.compute.manager [req-56293fe8-3884-4be3-8318-3243a9db7230 req-fce07b80-c3d9-4222-8524-692e46a46ab3 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state building and task_state spawning.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:50:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance spawned successfully.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:44 user nova-compute[75095]: INFO nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Took 6.38 seconds to spawn the instance on the hypervisor.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:50:44 user nova-compute[75095]: INFO nova.compute.manager [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Took 7.08 seconds to build instance.
Nov 15 15:50:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-857a1a69-8a86-4423-86fa-1153836f5884 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.167s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:50:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance spawned successfully.
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:50:45 user nova-compute[75095]: INFO nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Took 6.70 seconds to spawn the instance on the hypervisor.
Nov 15 15:50:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:50:45 user nova-compute[75095]: INFO nova.compute.manager [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Took 7.70 seconds to build instance.
Nov 15 15:50:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bcdaed43-7e14-404e-8bb5-a6b062ca503c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.832s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:46 user nova-compute[75095]: WARNING nova.compute.manager [req-16f8a61a-4c75-4b16-a43a-29427b4dd542 req-737f6193-f5c6-46b3-8dc5-f230e3d3656c service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state None.
Nov 15 15:50:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:56 user nova-compute[75095]: INFO nova.compute.manager [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Terminating instance
Nov 15 15:50:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-unplugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] No waiting events found dispatching network-vif-unplugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-b354f8e7-3e9b-49ec-8639-87bd4c4a0e60 req-d031a4af-accb-43c6-a829-6b8d04fc2543 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-unplugged-71448237-520d-453f-bcf7-9b1e1009bc68 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Instance destroyed successfully.
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.objects.instance [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lazy-loading 'resources' on Instance uuid a552ab2a-2123-45c2-914f-16e558f12af4 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-659751637',display_name='tempest-ServersNegativeTestJSON-server-659751637',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-659751637',id=23,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:49:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-01bzo9wo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:49:13Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=a552ab2a-2123-45c2-914f-16e558f12af4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "71448237-520d-453f-bcf7-9b1e1009bc68", "address": "fa:16:3e:40:f3:e1", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71448237-52", "ovs_interfaceid": "71448237-520d-453f-bcf7-9b1e1009bc68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG os_vif [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71448237-52, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bfb71098-e4e5-49cd-b7bc-6873916e0b0e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:50:57 user nova-compute[75095]: INFO os_vif [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:f3:e1,bridge_name='br-int',has_traffic_filtering=True,id=71448237-520d-453f-bcf7-9b1e1009bc68,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71448237-52')
Nov 15 15:50:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Deleting instance files /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4_del
Nov 15 15:50:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Deletion of /opt/stack/data/nova/instances/a552ab2a-2123-45c2-914f-16e558f12af4_del complete
Nov 15 15:50:57 user nova-compute[75095]: INFO nova.compute.manager [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:50:57 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Took 0.49 seconds to deallocate network for instance.
Nov 15 15:50:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-b3ac9217-0f72-4a76-b4f9-2f36e399f1c0 req-8135a49c-f4b5-44a0-93d9-21c2983270bb service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-deleted-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:50:58 user nova-compute[75095]: INFO nova.compute.manager [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Detaching volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:58 user nova-compute[75095]: INFO nova.virt.block_device [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Attempting to driver detach volume 8365b8c1-c8d4-42ee-9eef-91da5d46c272 from mountpoint /dev/vdb
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Attempting to detach device vdb from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:50:58 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:58 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 15:50:58 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:50:58 user nova-compute[75095]:   <serial>8365b8c1-c8d4-42ee-9eef-91da5d46c272</serial>
Nov 15 15:50:58 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 15:50:58 user nova-compute[75095]: </disk>
Nov 15 15:50:58 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:50:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully detached device vdb from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the persistent domain config.
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:50:58 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:50:58 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 15:50:58 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:50:58 user nova-compute[75095]:   <serial>8365b8c1-c8d4-42ee-9eef-91da5d46c272</serial>
Nov 15 15:50:58 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 15:50:58 user nova-compute[75095]: </disk>
Nov 15 15:50:58 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:50:58 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Deleted allocations for instance a552ab2a-2123-45c2-914f-16e558f12af4
Nov 15 15:50:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-b8b30d70-1bd6-46ca-9e7a-bc989488208b tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "a552ab2a-2123-45c2-914f-16e558f12af4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.721s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:50:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:50:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:50:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] Acquiring lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:50:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:50:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] Lock "a552ab2a-2123-45c2-914f-16e558f12af4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:50:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] No waiting events found dispatching network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:50:59 user nova-compute[75095]: WARNING nova.compute.manager [req-3dc371c4-e373-4485-893f-cf237b576e7d req-7cdf715c-7865-465b-b111-73c25daf8c96 service nova] [instance: a552ab2a-2123-45c2-914f-16e558f12af4] Received unexpected event network-vif-plugged-71448237-520d-453f-bcf7-9b1e1009bc68 for instance with vm_state deleted and task_state None.
Nov 15 15:51:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:02 user nova-compute[75095]: INFO nova.compute.manager [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Terminating instance
Nov 15 15:51:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-unplugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] No waiting events found dispatching network-vif-unplugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-2035721a-31de-4443-8a3a-4445c3d068a7 req-a941638b-6782-439f-9b68-f513f6571dbb service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-unplugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Instance destroyed successfully.
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lazy-loading 'resources' on Instance uuid b88184a5-9c2d-4005-a46a-f595b7be5efe {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1335325889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1335325',id=20,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSUm9QUrUExrfs4v/ePz1RlaY2ujy6QsGK6t6/qDDPJS+fYUukbGt3AFQWfpTKn1M9Z224xvr3eZ8SvDuZkUle6djqtyVVgYEAAZlaOStZ7Yh7cBbaLYFztoWZynPty7g==',key_name='tempest-keypair-374616655',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:48:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76802ebc10124616875959183e7cf3ab',ramdisk_id='',reservation_id='r-tvgq4p9l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dc038f8167534a84b3eaf5f51a0b48b4',uuid=b88184a5-9c2d-4005-a46a-f595b7be5efe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converting VIF {"id": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "address": "fa:16:3e:a0:f7:dc", "network": {"id": "5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-490220269-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76802ebc10124616875959183e7cf3ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1bebef6-c5", "ovs_interfaceid": "f1bebef6-c544-45fe-bf9e-63dbca401df1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG os_vif [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1bebef6-c5, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc031f79-1435-4814-b5dd-242c4feb9e5a) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:03 user nova-compute[75095]: INFO os_vif [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:f7:dc,bridge_name='br-int',has_traffic_filtering=True,id=f1bebef6-c544-45fe-bf9e-63dbca401df1,network=Network(5b779cff-3ad1-4cbd-a67d-cdf188eb1ccf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1bebef6-c5')
Nov 15 15:51:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Deleting instance files /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe_del
Nov 15 15:51:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Deletion of /opt/stack/data/nova/instances/b88184a5-9c2d-4005-a46a-f595b7be5efe_del complete
Nov 15 15:51:03 user nova-compute[75095]: INFO nova.compute.manager [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 15:51:03 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:51:03 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:51:04 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:04 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Took 0.71 seconds to deallocate network for instance.
Nov 15 15:51:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:04 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:51:04 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:51:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:05 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Deleted allocations for instance b88184a5-9c2d-4005-a46a-f595b7be5efe
Nov 15 15:51:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-826bb266-2ed8-4767-9321-a065ca044702 tempest-TestServerVolumeAttachScenarioOldVersion-935440045 tempest-TestServerVolumeAttachScenarioOldVersion-935440045-project-member] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.376s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] Acquiring lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] Lock "b88184a5-9c2d-4005-a46a-f595b7be5efe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] No waiting events found dispatching network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:05 user nova-compute[75095]: WARNING nova.compute.manager [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received unexpected event network-vif-plugged-f1bebef6-c544-45fe-bf9e-63dbca401df1 for instance with vm_state deleted and task_state None.
Nov 15 15:51:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-654325e5-ad4c-4f68-aa05-928d5e9db986 req-954e9fd5-525e-46a2-9cdd-6bdae99565ae service nova] [instance: b88184a5-9c2d-4005-a46a-f595b7be5efe] Received event network-vif-deleted-f1bebef6-c544-45fe-bf9e-63dbca401df1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:51:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:51:14 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updating instance_info_cache with network_info: [{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:51:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:51:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:51:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa is timed out.
Nov 15 15:51:18 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully detached device vdb from instance 497c558c-8e03-4dd5-ab88-8df09337e0fa from the live domain config.
Nov 15 15:51:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jIqbUoeL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:51:18 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbcccb2-251d-45b8-b1e0-6b21017db4ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:51:18 user nova-compute[75095]: No targets found.
Nov 15 15:51:18 user nova-compute[75095]: iSNS:
Nov 15 15:51:18 user nova-compute[75095]: No targets found.
Nov 15 15:51:18 user nova-compute[75095]: STATIC:
Nov 15 15:51:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:51:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:51:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:51:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:51:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:51:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:51:18 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272
Nov 15 15:51:18 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:51:18 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:51:18 user nova-compute[75095]: FIRMWARE:
Nov 15 15:51:18 user nova-compute[75095]: No targets found.
Nov 15 15:51:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:51:18 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:51:18 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a639dd0-030e-4daa-b728-2d5292636c8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[395ded37-e191-4282-8192-2e6b16867d80]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:51:18 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:18 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 (non-flash)
Nov 15 15:51:18 user nova-compute[75095]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:18 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[508accfc-1153-49e1-8fb6-d51f62b3d4f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b8e468-1a65-44fc-baaa-e07c1879bf24]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c37e9f-639a-45a2-a06d-25ddc5f079b3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be30a740-ae00-4da2-bb5e-5cb60073eb61]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b91b4-3bad-4b52-9cd8-a705b3f51c99]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[18679afb-fb9b-4d1a-96c7-2dca0e7bf3c0]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260]
Nov 15 15:51:18 user nova-compute[75095]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272, portal: 172.16.0.220,3260] successful.
Nov 15 15:51:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8365b8c1-c8d4-42ee-9eef-91da5d46c272 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a041f-d06a-47b8-93b2-1d63a1fa7c45]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== disconnect_volume: return (392ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:51:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7356MB free_disk=24.495647430419922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 497c558c-8e03-4dd5-ab88-8df09337e0fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:51:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'flavor' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ceb18a39-7e94-4e12-a0ac-0ee5d7cd8f74 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.481s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:51:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:51:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-changed-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Refreshing instance network info cache due to event network-changed-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] Acquiring lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] Acquired lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG nova.network.neutron [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Refreshing network info cache for port 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Ignoring supplied device name: /dev/vdb
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:37 user nova-compute[75095]: INFO nova.compute.manager [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Attaching volume aa15ed1b-9467-4ad3-89e0-53a4614d3757 to /dev/vdb
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.utils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5301f-11b2-45e2-be2c-20ca88ac4c47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[033e3028-d3a1-43f5-b8a2-d61c01c687a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea4dc8-33e9-460a-8dce-cdda13a43985]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[026ce5f6-8224-4eaf-b66b-e2a5275a4e15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:51:37 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d494a-f98f-4871-b771-87c7fa7bdd67]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG os_brick.utils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updating existing volume attachment record: ec8bfd19-9e45-421b-b5ef-2110add02f86 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updated VIF entry in instance network info cache for port 9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updating instance_info_cache with network_info: [{"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed70b217-c19a-4b72-bb8e-c96d448cd6a9 req-4a0c04e9-3a5b-4faf-919f-7fc74e34cf30 service nova] Releasing lock "refresh_cache-34b46dc8-281e-49bb-96ce-1494e2d7e04f" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:51:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHChzBAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:51:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:51:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:51:45 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b3bf28-7c41-4b94-a8e2-b8cf1b02d5ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:51:45 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a029e83-5acc-4d85-889a-c69daa8dadee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757] added
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06894acd-9a12-48da-8647-13d6972bd1a4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2562c1b-fe25-4119-9945-128043bce1fc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHChzBAE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NHChzBAE" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4dac84-004a-4350-b859-434a9ca7c4a6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NHChzBAE'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0375a0e-1d20-45df-8176-4b4390648734]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0aaeba-f5cc-487b-a30d-be037ebbfc57]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fadf819-2b29-43f2-acac-07a9d17b914e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260]
Nov 15 15:51:45 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260] successful.
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c6ed7-6e60-4a91-a0d6-679acadf4417]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80f1588-08f8-40aa-8361-89e41658c2f6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:51:45 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:51:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d5a491-d5b8-4d61-9860-4401bf47b0f4]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:51:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHChzBAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:51:46 user nova-compute[75095]: INFO nova.compute.claims [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Claim successful on node user
Nov 15 15:51:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26236386437653265', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236386437653265', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:51:46 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:51:46 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:51:46 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:51:46 user nova-compute[75095]:   <serial>aa15ed1b-9467-4ad3-89e0-53a4614d3757</serial>
Nov 15 15:51:46 user nova-compute[75095]: </disk>
Nov 15 15:51:46 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:51:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:51:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.policy [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d584f2b0224d5aa6569a95556e0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1e4e79a5944d438bfacae28fd86ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:51:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Creating image(s)
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "/opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "/opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No VIF found with MAC fa:16:3e:e7:b1:19, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.207s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-552c8198-6d1e-4060-8bff-e2b13774db55 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.197s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk 1073741824" returned: 0 in 0.061s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Successfully created port: ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Cannot resize image /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Ensure instance console log exists: /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:48 user nova-compute[75095]: INFO nova.compute.manager [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Terminating instance
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Successfully updated port: ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquired lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-e3680575-87c8-45a4-85a1-3eac8b75dc13 req-81d7eea3-53aa-47c0-92d0-2cf0c44f68df service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Instance destroyed successfully.
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'resources' on Instance uuid 497c558c-8e03-4dd5-ab88-8df09337e0fa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T15:46:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-699262549',display_name='tempest-ServerActionsTestOtherA-server-926662284',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-699262549',id=15,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBL3KDARi3OEVNXIhl0pAbzbbsz2DNfqsc3kxN3ObexMvoC3eyls8GHPkEn3oa5+ls9jdwSUVHEuTDX56unIVH6uGBnWBj5DQJc/OI5kBcpcKj/DuRqvYj4UgFfh8HSKpQ==',key_name='tempest-keypair-545373946',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-iwrwq4lj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:48:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=497c558c-8e03-4dd5-ab88-8df09337e0fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "address": "fa:16:3e:5e:cc:2c", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a39a1cd-8a", "ovs_interfaceid": "6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG os_vif [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a39a1cd-8a, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3911f509-2531-4863-8618-fba19310d0d2) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:49 user nova-compute[75095]: INFO os_vif [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:cc:2c,bridge_name='br-int',has_traffic_filtering=True,id=6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a39a1cd-8a')
Nov 15 15:51:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Deleting instance files /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa_del
Nov 15 15:51:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Deletion of /opt/stack/data/nova/instances/497c558c-8e03-4dd5-ab88-8df09337e0fa_del complete
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: INFO nova.compute.manager [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 15:51:49 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Updating instance_info_cache with network_info: [{"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Releasing lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Instance network_info: |[{"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Start _get_guest_xml network_info=[{"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:51:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:51:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1166690213',display_name='tempest-VolumesAdminNegativeTest-server-1166690213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1166690213',id=28,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWUnq9xDWAeWFhOAmDdHjXxAw8s3XyERIAQNZUXOfdnoobFbnVeyHeRcQlFcnK9MshbcLaSBww2yCLZye7g4TIyBaPO2lgSDP3RpfiiSdn2+bXAJ/C6dTAgg/ob15F9hQ==',key_name='tempest-keypair-219902262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-5hvu01wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07d584f2b0224d5aa6569a95556e0365',uuid=b9836a76-0313-4058-857f-777075521311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'pci_devices' on Instance uuid b9836a76-0313-4058-857f-777075521311 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:51:49 user nova-compute[75095]:   <uuid>b9836a76-0313-4058-857f-777075521311</uuid>
Nov 15 15:51:49 user nova-compute[75095]:   <name>instance-0000001c</name>
Nov 15 15:51:49 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:51:49 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:51:49 user nova-compute[75095]:   <metadata>
Nov 15 15:51:49 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:51:49 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1166690213</nova:name>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:51:49</nova:creationTime>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:51:49 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:51:49 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:owner>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:user uuid="07d584f2b0224d5aa6569a95556e0365">tempest-VolumesAdminNegativeTest-1780720036-project-member</nova:user>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:project uuid="fc1e4e79a5944d438bfacae28fd86ada">tempest-VolumesAdminNegativeTest-1780720036</nova:project>
Nov 15 15:51:49 user nova-compute[75095]:       </nova:owner>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:51:49 user nova-compute[75095]:       <nova:ports>
Nov 15 15:51:49 user nova-compute[75095]:         <nova:port uuid="ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b">
Nov 15 15:51:49 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:51:49 user nova-compute[75095]:         </nova:port>
Nov 15 15:51:49 user nova-compute[75095]:       </nova:ports>
Nov 15 15:51:49 user nova-compute[75095]:     </nova:instance>
Nov 15 15:51:49 user nova-compute[75095]:   </metadata>
Nov 15 15:51:49 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:51:49 user nova-compute[75095]:     <system>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="serial">b9836a76-0313-4058-857f-777075521311</entry>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="uuid">b9836a76-0313-4058-857f-777075521311</entry>
Nov 15 15:51:49 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:51:49 user nova-compute[75095]:     </system>
Nov 15 15:51:49 user nova-compute[75095]:   </sysinfo>
Nov 15 15:51:49 user nova-compute[75095]:   <os>
Nov 15 15:51:49 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:51:49 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:51:49 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:51:49 user nova-compute[75095]:   </os>
Nov 15 15:51:49 user nova-compute[75095]:   <features>
Nov 15 15:51:49 user nova-compute[75095]:     <acpi/>
Nov 15 15:51:49 user nova-compute[75095]:     <apic/>
Nov 15 15:51:49 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:51:49 user nova-compute[75095]:   </features>
Nov 15 15:51:49 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:51:49 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:51:49 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:51:49 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:51:49 user nova-compute[75095]:   </clock>
Nov 15 15:51:49 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:51:49 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:51:49 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:51:49 user nova-compute[75095]:   </cpu>
Nov 15 15:51:49 user nova-compute[75095]:   <devices>
Nov 15 15:51:49 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:51:49 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:51:49 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk"/>
Nov 15 15:51:49 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:51:49 user nova-compute[75095]:     </disk>
Nov 15 15:51:49 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:51:49 user nova-compute[75095]:       <mac address="fa:16:3e:4c:92:f5"/>
Nov 15 15:51:49 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:51:49 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:51:49 user nova-compute[75095]:       <target dev="tapebc29e8f-23"/>
Nov 15 15:51:49 user nova-compute[75095]:     </interface>
Nov 15 15:51:49 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:51:49 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/console.log" append="off"/>
Nov 15 15:51:49 user nova-compute[75095]:     </serial>
Nov 15 15:51:49 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:51:49 user nova-compute[75095]:     <video>
Nov 15 15:51:49 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:51:49 user nova-compute[75095]:     </video>
Nov 15 15:51:49 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:51:49 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:51:49 user nova-compute[75095]:     </rng>
Nov 15 15:51:49 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:51:49 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:51:49 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:51:49 user nova-compute[75095]:     </memballoon>
Nov 15 15:51:49 user nova-compute[75095]:   </devices>
Nov 15 15:51:49 user nova-compute[75095]: </domain>
Nov 15 15:51:49 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1166690213',display_name='tempest-VolumesAdminNegativeTest-server-1166690213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1166690213',id=28,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWUnq9xDWAeWFhOAmDdHjXxAw8s3XyERIAQNZUXOfdnoobFbnVeyHeRcQlFcnK9MshbcLaSBww2yCLZye7g4TIyBaPO2lgSDP3RpfiiSdn2+bXAJ/C6dTAgg/ob15F9hQ==',key_name='tempest-keypair-219902262',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-5hvu01wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07d584f2b0224d5aa6569a95556e0365',uuid=b9836a76-0313-4058-857f-777075521311,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG os_vif [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b713b7c-d790-5176-8560-3fbdae1eb10b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebc29e8f-23, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebc29e8f-23, col_values=(('qos', UUID('69d63bd5-7552-46d9-9658-18e42ea2417e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebc29e8f-23, col_values=(('external_ids', {'iface-id': 'ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:92:f5', 'vm-uuid': 'b9836a76-0313-4058-857f-777075521311'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:49 user nova-compute[75095]: INFO os_vif [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23')
Nov 15 15:51:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:51:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No VIF found with MAC fa:16:3e:4c:92:f5, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:51:50 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:50 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Took 1.46 seconds to deallocate network for instance.
Nov 15 15:51:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-changed-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: b9836a76-0313-4058-857f-777075521311] Refreshing instance network info cache due to event network-changed-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquired lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: b9836a76-0313-4058-857f-777075521311] Refreshing network info cache for port ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Deleted allocations for instance 497c558c-8e03-4dd5-ab88-8df09337e0fa
Nov 15 15:51:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0b97e6f2-9a52-41e6-b3b7-098218096aa0 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.040s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: b9836a76-0313-4058-857f-777075521311] Updated VIF entry in instance network info cache for port ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: b9836a76-0313-4058-857f-777075521311] Updating instance_info_cache with network_info: [{"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Releasing lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:51 user nova-compute[75095]: WARNING nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state deleted and task_state None.
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:51 user nova-compute[75095]: WARNING nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state deleted and task_state None.
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:51 user nova-compute[75095]: WARNING nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state deleted and task_state None.
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:51 user nova-compute[75095]: WARNING nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-unplugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state deleted and task_state None.
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Acquiring lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] Lock "497c558c-8e03-4dd5-ab88-8df09337e0fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] No waiting events found dispatching network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:51 user nova-compute[75095]: WARNING nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received unexpected event network-vif-plugged-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 for instance with vm_state deleted and task_state None.
Nov 15 15:51:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-84a54d5f-cc12-45e7-8d2a-3f9e6f687504 req-148d5f9f-84f5-472e-8688-f9d1397edb5b service nova] [instance: 497c558c-8e03-4dd5-ab88-8df09337e0fa] Received event network-vif-deleted-6a39a1cd-8ac6-48fd-ab7b-577ea0d8a9c6 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-changed-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Refreshing instance network info cache due to event network-changed-e180701e-156f-4c51-8282-1806863e595c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] Acquiring lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] Acquired lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:51:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Refreshing network info cache for port e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Acquiring lock "b9836a76-0313-4058-857f-777075521311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] No waiting events found dispatching network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:53 user nova-compute[75095]: WARNING nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received unexpected event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b for instance with vm_state building and task_state spawning.
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Acquiring lock "b9836a76-0313-4058-857f-777075521311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] No waiting events found dispatching network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:51:53 user nova-compute[75095]: WARNING nova.compute.manager [req-65fc7bc0-019e-4953-98e1-65a06f055884 req-bde400b5-0366-48c0-a90c-e31b538f06ca service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received unexpected event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b for instance with vm_state building and task_state spawning.
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.network.neutron [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updated VIF entry in instance network info cache for port e180701e-156f-4c51-8282-1806863e595c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.network.neutron [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating instance_info_cache with network_info: [{"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-30d1254d-7d1e-4443-9e4a-00c50eccaaba req-69962ff4-5c63-41d7-a67b-8bbd474ce6fa service nova] Releasing lock "refresh_cache-6445dc31-6825-4762-9d09-b95ea70e5df3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:51:53 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b9836a76-0313-4058-857f-777075521311] Instance spawned successfully.
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:51:53 user nova-compute[75095]: INFO nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Took 6.76 seconds to spawn the instance on the hypervisor.
Nov 15 15:51:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:51:53 user nova-compute[75095]: INFO nova.compute.manager [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Took 7.66 seconds to build instance.
Nov 15 15:51:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2ed8b58a-dc20-4932-8eea-a1482ea09afd tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.782s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:51:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:51:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:52:01 user nova-compute[75095]: INFO nova.compute.claims [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Claim successful on node user
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.compute.manager [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Detaching volume aa15ed1b-9467-4ad3-89e0-53a4614d3757
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.virt.block_device [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Attempting to driver detach volume aa15ed1b-9467-4ad3-89e0-53a4614d3757 from mountpoint /dev/vdb
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Attempting to detach device vdb from instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:52:02 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:52:02 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:52:02 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:52:02 user nova-compute[75095]:   <serial>aa15ed1b-9467-4ad3-89e0-53a4614d3757</serial>
Nov 15 15:52:02 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:52:02 user nova-compute[75095]: </disk>
Nov 15 15:52:02 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully detached device vdb from instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f from the persistent domain config.
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:52:02 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:52:02 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:52:02 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:52:02 user nova-compute[75095]:   <serial>aa15ed1b-9467-4ad3-89e0-53a4614d3757</serial>
Nov 15 15:52:02 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:52:02 user nova-compute[75095]: </disk>
Nov 15 15:52:02 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.compute.manager [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Unrescuing
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:52:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:52:02 user nova-compute[75095]: INFO nova.virt.block_device [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Booting with volume snapshot c319e9b2-df62-4b2d-8f74-7f2be9be813d at /dev/vda
Nov 15 15:52:03 user nova-compute[75095]: DEBUG nova.policy [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'flavor' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:04 user nova-compute[75095]: WARNING nova.compute.manager [req-9ec9b401-b193-4cba-a602-74c6a6bc6399 req-3b62d2b4-62e9-4549-80b5-bf527753388d service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:52:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance destroyed successfully.
Nov 15 15:52:04 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Successfully created port: e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:52:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Successfully updated port: e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updating instance_info_cache with network_info: [{"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Instance network_info: |[{"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:06 user nova-compute[75095]: WARNING nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-changed-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Refreshing instance network info cache due to event network-changed-e517354d-bf9e-42a7-a300-cfb9822959c3. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Acquiring lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Acquired lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Refreshing network info cache for port e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updated VIF entry in instance network info cache for port e517354d-bf9e-42a7-a300-cfb9822959c3. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updating instance_info_cache with network_info: [{"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Releasing lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:06 user nova-compute[75095]: WARNING nova.compute.manager [req-0d6cf735-1dd1-4c3c-8ecb-f98c81df7e0c req-74b0230a-3814-4ca7-ac3f-632f94546b9a service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:52:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:52:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:52:07 user nova-compute[75095]: INFO nova.compute.claims [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Claim successful on node user
Nov 15 15:52:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6e93fa1b-afb3-48b7-91f7-efae15b655e6 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:08 user nova-compute[75095]: WARNING nova.compute.manager [req-398cc1dd-a05e-4ac9-9386-6c2fd71b374d req-75f69249-a317-4326-b2b5-52e5ad36a1f7 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state None.
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:52:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.policy [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2bb770140d8b49f89d13559e60ebd61a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f44d10e736d40559bb878cfd0b21326', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:52:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Creating image(s)
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "/opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "/opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.utils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[867e7ce0-74d1-4bd8-b72e-dee99b86948e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d843b600-9b2d-4f94-be03-c68a4900d994]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0da4b4e-5060-4426-943a-e4cd1af97897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ab6864-2f7f-49dd-bcb5-4f3658437148]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:52:08 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1aa94a-ba60-43b9-94e7-a8a4080e6241]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG os_brick.utils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updating existing volume attachment record: c91c8f24-f4b6-40c3-9c5b-d39fa22a10f5 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk 1073741824" returned: 0 in 0.049s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Successfully created port: 98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Cannot resize image /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Ensure instance console log exists: /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Successfully updated port: 98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquired lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating instance_info_cache with network_info: [{"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Releasing lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Instance network_info: |[{"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Start _get_guest_xml network_info=[{"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:52:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-changed-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Refreshing instance network info cache due to event network-changed-98eb3d10-702d-4bc6-9630-91d167a5b06c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] Acquiring lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] Acquired lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Refreshing network info cache for port 98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-258778721',display_name='tempest-SnapshotDataIntegrityTests-server-258778721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-258778721',id=30,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYluKDxOSgC6Y4I0JihtXQgPLt3qnXu3JuZD36OT+RWECWZgtJhupOLAEN5606o93IM7z+8RKEL9DwEKoItruKhmalMZakmUCDF7TfVatREPEngE0zLNdqjGATanv+smA==',key_name='tempest-keypair-1444610908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f44d10e736d40559bb878cfd0b21326',ramdisk_id='',reservation_id='r-0fnpbyt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2139963622',owner_user_name='tempest-SnapshotDataIntegrityTests-2139963622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bb770140d8b49f89d13559e60ebd61a',uuid=7e5b52ab-eebc-4194-b588-7b688f7f2ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converting VIF {"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:52:10 user nova-compute[75095]:   <uuid>7e5b52ab-eebc-4194-b588-7b688f7f2ba3</uuid>
Nov 15 15:52:10 user nova-compute[75095]:   <name>instance-0000001e</name>
Nov 15 15:52:10 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:52:10 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:52:10 user nova-compute[75095]:   <metadata>
Nov 15 15:52:10 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:52:10 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-258778721</nova:name>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:52:10</nova:creationTime>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:52:10 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:52:10 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:owner>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:user uuid="2bb770140d8b49f89d13559e60ebd61a">tempest-SnapshotDataIntegrityTests-2139963622-project-member</nova:user>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:project uuid="7f44d10e736d40559bb878cfd0b21326">tempest-SnapshotDataIntegrityTests-2139963622</nova:project>
Nov 15 15:52:10 user nova-compute[75095]:       </nova:owner>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:52:10 user nova-compute[75095]:       <nova:ports>
Nov 15 15:52:10 user nova-compute[75095]:         <nova:port uuid="98eb3d10-702d-4bc6-9630-91d167a5b06c">
Nov 15 15:52:10 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:52:10 user nova-compute[75095]:         </nova:port>
Nov 15 15:52:10 user nova-compute[75095]:       </nova:ports>
Nov 15 15:52:10 user nova-compute[75095]:     </nova:instance>
Nov 15 15:52:10 user nova-compute[75095]:   </metadata>
Nov 15 15:52:10 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:52:10 user nova-compute[75095]:     <system>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="serial">7e5b52ab-eebc-4194-b588-7b688f7f2ba3</entry>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="uuid">7e5b52ab-eebc-4194-b588-7b688f7f2ba3</entry>
Nov 15 15:52:10 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:52:10 user nova-compute[75095]:     </system>
Nov 15 15:52:10 user nova-compute[75095]:   </sysinfo>
Nov 15 15:52:10 user nova-compute[75095]:   <os>
Nov 15 15:52:10 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:52:10 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:52:10 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:52:10 user nova-compute[75095]:   </os>
Nov 15 15:52:10 user nova-compute[75095]:   <features>
Nov 15 15:52:10 user nova-compute[75095]:     <acpi/>
Nov 15 15:52:10 user nova-compute[75095]:     <apic/>
Nov 15 15:52:10 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:52:10 user nova-compute[75095]:   </features>
Nov 15 15:52:10 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:52:10 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:52:10 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:52:10 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:52:10 user nova-compute[75095]:   </clock>
Nov 15 15:52:10 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:52:10 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:52:10 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:52:10 user nova-compute[75095]:   </cpu>
Nov 15 15:52:10 user nova-compute[75095]:   <devices>
Nov 15 15:52:10 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:52:10 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:52:10 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk"/>
Nov 15 15:52:10 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:52:10 user nova-compute[75095]:     </disk>
Nov 15 15:52:10 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:52:10 user nova-compute[75095]:       <mac address="fa:16:3e:5e:69:d0"/>
Nov 15 15:52:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:10 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:52:10 user nova-compute[75095]:       <target dev="tap98eb3d10-70"/>
Nov 15 15:52:10 user nova-compute[75095]:     </interface>
Nov 15 15:52:10 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:52:10 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/console.log" append="off"/>
Nov 15 15:52:10 user nova-compute[75095]:     </serial>
Nov 15 15:52:10 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:52:10 user nova-compute[75095]:     <video>
Nov 15 15:52:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:10 user nova-compute[75095]:     </video>
Nov 15 15:52:10 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:52:10 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:52:10 user nova-compute[75095]:     </rng>
Nov 15 15:52:10 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:52:10 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:52:10 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:52:10 user nova-compute[75095]:     </memballoon>
Nov 15 15:52:10 user nova-compute[75095]:   </devices>
Nov 15 15:52:10 user nova-compute[75095]: </domain>
Nov 15 15:52:10 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-258778721',display_name='tempest-SnapshotDataIntegrityTests-server-258778721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-258778721',id=30,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYluKDxOSgC6Y4I0JihtXQgPLt3qnXu3JuZD36OT+RWECWZgtJhupOLAEN5606o93IM7z+8RKEL9DwEKoItruKhmalMZakmUCDF7TfVatREPEngE0zLNdqjGATanv+smA==',key_name='tempest-keypair-1444610908',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7f44d10e736d40559bb878cfd0b21326',ramdisk_id='',reservation_id='r-0fnpbyt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2139963622',owner_user_name='tempest-SnapshotDataIntegrityTests-2139963622-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:52:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bb770140d8b49f89d13559e60ebd61a',uuid=7e5b52ab-eebc-4194-b588-7b688f7f2ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converting VIF {"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG os_vif [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '173de802-29a8-569a-b7de-042e989bcdd5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98eb3d10-70, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98eb3d10-70, col_values=(('qos', UUID('aa4614b0-9fe5-421f-9057-f012ee779251')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98eb3d10-70, col_values=(('external_ids', {'iface-id': '98eb3d10-702d-4bc6-9630-91d167a5b06c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:69:d0', 'vm-uuid': '7e5b52ab-eebc-4194-b588-7b688f7f2ba3'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:10 user nova-compute[75095]: INFO os_vif [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70')
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No VIF found with MAC fa:16:3e:5e:69:d0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updated VIF entry in instance network info cache for port 98eb3d10-702d-4bc6-9630-91d167a5b06c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating instance_info_cache with network_info: [{"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0fa83c65-31f1-47c0-b1fe-058dbd2bba9d req-21280be8-e39d-4c04-b9ad-13abf457df02 service nova] Releasing lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] No waiting events found dispatching network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:12 user nova-compute[75095]: WARNING nova.compute.manager [req-952eca73-fa6e-45f7-b31e-52289cc2f097 req-47904b2e-8859-4a3e-bad3-a118f1eee894 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received unexpected event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c for instance with vm_state building and task_state spawning.
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:52:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Creating image(s)
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Ensure instance console log exists: /opt/stack/data/nova/instances/9c6915a4-d62e-47ea-81f9-1b85e6e6e52d/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Start _get_guest_xml network_info=[{"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T15:51:56Z,direct_url=<?>,disk_format='qcow2',id=71c22a35-456a-47d1-86fc-c8c99259d601,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1457760252',owner='411ae82aac4242d6a14fd6625204b8fd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T15:51:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'c91c8f24-f4b6-40c3-9c5b-d39fa22a10f5', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqlRfvnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c6915a4-d62e-47ea-81f9-1b85e6e6e52d', 'attached_at': '', 'detached_at': '', 'volume_id': '678287ea-e465-4391-9b98-b5c1fc713d71', 'serial': '678287ea-e465-4391-9b98-b5c1fc713d71'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:52:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T15:51:56Z,direct_url=<?>,disk_format='qcow2',id=71c22a35-456a-47d1-86fc-c8c99259d601,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1457760252',owner='411ae82aac4242d6a14fd6625204b8fd',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T15:51:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:52:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqlRfvnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:52:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:52:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:52:14 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ab9010-5717-4c63-b9a7-c4e4ff2b7981]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:52:14 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b59ee0-7e3f-451f-a317-b90eba3d5028]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71] added
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feaa18f-9cd0-4f7d-958f-73ea41f3388e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f5402f-b340-43d6-903b-45d0f4b36d6e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqlRfvnW {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqlRfvnW" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db72c111-b7a7-4b4b-9c4f-fe49a373e7e8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqlRfvnW'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14954b1d-988e-4eb5-9c69-9200abeb50ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59828282-2703-4643-bd55-4b62a3caee1d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b376553-ae9e-424b-bab0-a0f315563126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260]
Nov 15 15:52:14 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260] successful.
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:52:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Instance spawned successfully.
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6396f960-259c-40e4-8abe-a982d415a7da]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae42b1ef-b70b-4c23-8e57-5dda46078ca6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00963617-cd36-429a-9d2d-50daaa0c27d9]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] No waiting events found dispatching network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:14 user nova-compute[75095]: WARNING nova.compute.manager [req-f890e518-89b4-4d09-96f0-455f564827d6 req-953f7290-2725-4781-86de-31fff49418d0 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received unexpected event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c for instance with vm_state building and task_state spawning.
Nov 15 15:52:14 user nova-compute[75095]: INFO nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 15 15:52:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:52:14 user nova-compute[75095]: INFO nova.compute.manager [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Took 6.60 seconds to build instance.
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9eade275-deea-4323-9ecb-f9df530c0deb tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.714s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqlRfvnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26539303637633661', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539303637633661', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-421188492',id=29,image_ref='71c22a35-456a-47d1-86fc-c8c99259d601',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyyGqvIKtW93EC3kWPVdd+GgjOuw4rejsHFgTEEC1YIaYEjkb1E6/+nGVEWtufEyG32A7ux3raeFmPGpzGDy3cw4+nqAAmbvoABQ0TsIQPBGpAhkR+1OTjcqn/UXK6Wyg==',key_name='tempest-keypair-1266206588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-zj593p0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108978395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9c6915a4-d62e-47ea-81f9-1b85e6e6e52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.objects.instance [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:52:15 user nova-compute[75095]:   <uuid>9c6915a4-d62e-47ea-81f9-1b85e6e6e52d</uuid>
Nov 15 15:52:15 user nova-compute[75095]:   <name>instance-0000001d</name>
Nov 15 15:52:15 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:52:15 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:52:15 user nova-compute[75095]:   <metadata>
Nov 15 15:52:15 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:52:15 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-421188492</nova:name>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:52:13</nova:creationTime>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:52:15 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:52:15 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:owner>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 15:52:15 user nova-compute[75095]:       </nova:owner>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:root type="image" uuid="71c22a35-456a-47d1-86fc-c8c99259d601"/>
Nov 15 15:52:15 user nova-compute[75095]:       <nova:ports>
Nov 15 15:52:15 user nova-compute[75095]:         <nova:port uuid="e517354d-bf9e-42a7-a300-cfb9822959c3">
Nov 15 15:52:15 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:52:15 user nova-compute[75095]:         </nova:port>
Nov 15 15:52:15 user nova-compute[75095]:       </nova:ports>
Nov 15 15:52:15 user nova-compute[75095]:     </nova:instance>
Nov 15 15:52:15 user nova-compute[75095]:   </metadata>
Nov 15 15:52:15 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:52:15 user nova-compute[75095]:     <system>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="serial">9c6915a4-d62e-47ea-81f9-1b85e6e6e52d</entry>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="uuid">9c6915a4-d62e-47ea-81f9-1b85e6e6e52d</entry>
Nov 15 15:52:15 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:52:15 user nova-compute[75095]:     </system>
Nov 15 15:52:15 user nova-compute[75095]:   </sysinfo>
Nov 15 15:52:15 user nova-compute[75095]:   <os>
Nov 15 15:52:15 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:52:15 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:52:15 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:52:15 user nova-compute[75095]:   </os>
Nov 15 15:52:15 user nova-compute[75095]:   <features>
Nov 15 15:52:15 user nova-compute[75095]:     <acpi/>
Nov 15 15:52:15 user nova-compute[75095]:     <apic/>
Nov 15 15:52:15 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:52:15 user nova-compute[75095]:   </features>
Nov 15 15:52:15 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:52:15 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:52:15 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:52:15 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:52:15 user nova-compute[75095]:   </clock>
Nov 15 15:52:15 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:52:15 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:52:15 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:52:15 user nova-compute[75095]:   </cpu>
Nov 15 15:52:15 user nova-compute[75095]:   <devices>
Nov 15 15:52:15 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:52:15 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:52:15 user nova-compute[75095]:       <source dev="/dev/sdd"/>
Nov 15 15:52:15 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:52:15 user nova-compute[75095]:       <serial>678287ea-e465-4391-9b98-b5c1fc713d71</serial>
Nov 15 15:52:15 user nova-compute[75095]:     </disk>
Nov 15 15:52:15 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:52:15 user nova-compute[75095]:       <mac address="fa:16:3e:7e:2e:e8"/>
Nov 15 15:52:15 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:15 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:52:15 user nova-compute[75095]:       <target dev="tape517354d-bf"/>
Nov 15 15:52:15 user nova-compute[75095]:     </interface>
Nov 15 15:52:15 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:52:15 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/9c6915a4-d62e-47ea-81f9-1b85e6e6e52d/console.log" append="off"/>
Nov 15 15:52:15 user nova-compute[75095]:     </serial>
Nov 15 15:52:15 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:52:15 user nova-compute[75095]:     <video>
Nov 15 15:52:15 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:15 user nova-compute[75095]:     </video>
Nov 15 15:52:15 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:52:15 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:52:15 user nova-compute[75095]:     </rng>
Nov 15 15:52:15 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:52:15 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:52:15 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:52:15 user nova-compute[75095]:     </memballoon>
Nov 15 15:52:15 user nova-compute[75095]:   </devices>
Nov 15 15:52:15 user nova-compute[75095]: </domain>
Nov 15 15:52:15 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-421188492',id=29,image_ref='71c22a35-456a-47d1-86fc-c8c99259d601',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyyGqvIKtW93EC3kWPVdd+GgjOuw4rejsHFgTEEC1YIaYEjkb1E6/+nGVEWtufEyG32A7ux3raeFmPGpzGDy3cw4+nqAAmbvoABQ0TsIQPBGpAhkR+1OTjcqn/UXK6Wyg==',key_name='tempest-keypair-1266206588',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-zj593p0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108978395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:52:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9c6915a4-d62e-47ea-81f9-1b85e6e6e52d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG os_vif [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2c91c16-3863-5014-bfa6-5660cb3a200b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape517354d-bf, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape517354d-bf, col_values=(('qos', UUID('b609046f-8a08-4218-b07c-19c2a1002a26')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape517354d-bf, col_values=(('external_ids', {'iface-id': 'e517354d-bf9e-42a7-a300-cfb9822959c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:2e:e8', 'vm-uuid': '9c6915a4-d62e-47ea-81f9-1b85e6e6e52d'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:15 user nova-compute[75095]: INFO os_vif [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf')
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:52:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:7e:2e:e8, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:52:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:17 user nova-compute[75095]: WARNING nova.compute.manager [req-3e174602-4867-4a18-aeb7-362d8d5ccab2 req-50758f57-8457-4e8a-b63e-0528fe5646d0 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state building and task_state spawning.
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:52:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:19 user nova-compute[75095]: WARNING nova.compute.manager [req-200e30ce-f5cd-4836-8d4c-5f00b20c5035 req-27cdda81-5adc-4326-89fc-bc1eb5542b68 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state building and task_state spawning.
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Instance spawned successfully.
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:19 user nova-compute[75095]: INFO nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Took 5.64 seconds to spawn the instance on the hypervisor.
Nov 15 15:52:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:52:19 user nova-compute[75095]: INFO nova.compute.manager [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Took 18.24 seconds to build instance.
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d969de0-084f-4523-86ed-36910f283219 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.607s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:52:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=24.469940185546875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:52:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:22 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f is timed out.
Nov 15 15:52:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully detached device vdb from instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f from the live domain config.
Nov 15 15:52:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHChzBAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:52:22 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e206e58-bbc5-43f0-8f35-1134397fe2b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:52:22 user nova-compute[75095]: No targets found.
Nov 15 15:52:22 user nova-compute[75095]: iSNS:
Nov 15 15:52:22 user nova-compute[75095]: No targets found.
Nov 15 15:52:22 user nova-compute[75095]: STATIC:
Nov 15 15:52:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71
Nov 15 15:52:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:52:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:52:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757
Nov 15 15:52:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81
Nov 15 15:52:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:22 user nova-compute[75095]: FIRMWARE:
Nov 15 15:52:22 user nova-compute[75095]: No targets found.
Nov 15 15:52:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:52:22 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:52:22 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ce621-4109-429a-b478-b751ce8ed93f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bbf7f9-0425-4bd6-943f-68b584386cb2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)
Nov 15 15:52:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c14a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb696b8-19e2-4906-8bab-cb99e3ed87b2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a947da-bfcd-4be2-afb4-6c7bd507359f]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38790c80-b906-4eb6-89ca-d1490618bd12]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b843db-dfbb-4517-a872-1b4f41ad6fbe]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[776d4a94-1c98-477e-873d-8e662f632eec]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfed8f1-1b37-4dd5-8fe9-a993e20bf78d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260]
Nov 15 15:52:22 user nova-compute[75095]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757, portal: 172.16.0.220,3260] successful.
Nov 15 15:52:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f702cc-df98-4650-9602-61260834cdde]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== disconnect_volume: return (332ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-204e2321-1ebd-4941-9f81-6aebef8d60dd tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.863s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.676s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:23 user nova-compute[75095]: INFO nova.compute.manager [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Terminating instance
Nov 15 15:52:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-unplugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] No waiting events found dispatching network-vif-unplugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-cf9baa0f-232a-4d8f-b4ef-f0ad099fb171 req-2661d151-0575-45f7-b496-fd86a780a67f service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-unplugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:52:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Instance destroyed successfully.
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'resources' on Instance uuid 34b46dc8-281e-49bb-96ce-1494e2d7e04f {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:49:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1307889443',display_name='tempest-VolumesSnapshotTestJSON-instance-1307889443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1307889443',id=24,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcdsLgiF8QTtS44Pqcnvv3KYAi+0LqpHVHe4yLR5f7zVyNfTySvJZaiQhGZD+bfwqzdOVcyKmtJeK9wXRFhWL0YysYwv1/BVbJPgLQ91I66bjBW131yPT8JeAk1q96yWA==',key_name='tempest-keypair-100941630',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:49:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-14juu7az',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:49:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=34b46dc8-281e-49bb-96ce-1494e2d7e04f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "address": "fa:16:3e:e7:b1:19", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c4f4d1c-83", "ovs_interfaceid": "9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_vif [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c4f4d1c-83, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0411169b-32ca-4612-81f3-6769ac3460bc) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:24 user nova-compute[75095]: INFO os_vif [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b1:19,bridge_name='br-int',has_traffic_filtering=True,id=9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c4f4d1c-83')
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NHChzBAE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:52:24 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9138d99-9292-4e58-a052-a5d9137d4a55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:52:24 user nova-compute[75095]: No targets found.
Nov 15 15:52:24 user nova-compute[75095]: iSNS:
Nov 15 15:52:24 user nova-compute[75095]: No targets found.
Nov 15 15:52:24 user nova-compute[75095]: STATIC:
Nov 15 15:52:24 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71
Nov 15 15:52:24 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:24 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:24 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:52:24 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:24 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:24 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:52:24 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:24 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:24 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1
Nov 15 15:52:24 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:24 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:24 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81
Nov 15 15:52:24 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:52:24 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:52:24 user nova-compute[75095]: FIRMWARE:
Nov 15 15:52:24 user nova-compute[75095]: No targets found.
Nov 15 15:52:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:52:24 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:52:24 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aa15ed1b-9467-4ad3-89e0-53a4614d3757', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[313461c4-67c4-4d58-ac9b-90ee549ec6b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c092e9ae-9f7a-46b1-bb3d-6b13ffee8061]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75feed5d-47a0-44bb-93eb-ef45cfb1dd81 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52cad741-0baf-4512-8503-322b6b78c9c1 (non-flash)
Nov 15 15:52:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c45f2e0>, {}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Disconnecting from: [] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== disconnect_volume: return (74ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:52:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Deleting instance files /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f_del
Nov 15 15:52:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Deletion of /opt/stack/data/nova/instances/34b46dc8-281e-49bb-96ce-1494e2d7e04f_del complete
Nov 15 15:52:24 user nova-compute[75095]: INFO nova.compute.manager [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 15 15:52:24 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:52:24 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:26 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Took 1.35 seconds to deallocate network for instance.
Nov 15 15:52:26 user nova-compute[75095]: WARNING nova.volume.cinder [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Attachment ec8bfd19-9e45-421b-b5ef-2110add02f86 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ec8bfd19-9e45-421b-b5ef-2110add02f86. (HTTP 404) (Request-ID: req-f73c794c-ae64-4a9e-a967-8125a74066b6)
Nov 15 15:52:26 user nova-compute[75095]: INFO nova.compute.manager [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] Acquiring lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] No waiting events found dispatching network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:26 user nova-compute[75095]: WARNING nova.compute.manager [req-d2df4f1c-2ac1-4d93-988b-417f84be2e7c req-7e13b3bd-bed7-46ed-afd8-d95fabf73705 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received unexpected event network-vif-plugged-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae for instance with vm_state active and task_state deleting.
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-133287c4-6ab4-4a73-bf5e-72a709a1ba69 req-d1cbb61b-894d-4766-bffb-72e6880b8043 service nova] [instance: 34b46dc8-281e-49bb-96ce-1494e2d7e04f] Received event network-vif-deleted-9c4f4d1c-835d-42d3-b23b-2e7b7bcb68ae {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:26 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Deleted allocations for instance 34b46dc8-281e-49bb-96ce-1494e2d7e04f
Nov 15 15:52:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6d1e8d61-c88b-4664-a397-376ced2cf514 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "34b46dc8-281e-49bb-96ce-1494e2d7e04f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.998s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:28 user nova-compute[75095]: INFO nova.compute.manager [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Rescuing
Nov 15 15:52:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:52:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:52:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:52:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:29 user nova-compute[75095]: WARNING nova.compute.manager [req-ca1a589a-ab94-4dce-bb5a-28b243e990a5 req-c680fae1-8ced-44f6-8f33-a7a5f0b31a04 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:29 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance destroyed successfully.
Nov 15 15:52:29 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Attempting rescue
Nov 15 15:52:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 15:52:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:52:30 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Creating image(s)
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'trusted_certs' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.206s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue" returned: 0 in 0.059s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'migration_context' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start _get_guest_xml network_info=[{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:26:93:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'numa_topology' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:52:30 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:30 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'vcpu_model' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-486487011',display_name='tempest-ServerRescueNegativeTestJSON-server-486487011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-486487011',id=27,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:50:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-3chxgaqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:46Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:26:93:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:26:93:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:52:30 user nova-compute[75095]:   <uuid>bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</uuid>
Nov 15 15:52:30 user nova-compute[75095]:   <name>instance-0000001b</name>
Nov 15 15:52:30 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:52:30 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:52:30 user nova-compute[75095]:   <metadata>
Nov 15 15:52:30 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:52:30 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-486487011</nova:name>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:52:30</nova:creationTime>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:52:30 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:52:30 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:owner>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 15:52:30 user nova-compute[75095]:       </nova:owner>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:52:30 user nova-compute[75095]:       <nova:ports>
Nov 15 15:52:30 user nova-compute[75095]:         <nova:port uuid="cc369ea8-4685-43ea-b690-07b025a48169">
Nov 15 15:52:30 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:52:30 user nova-compute[75095]:         </nova:port>
Nov 15 15:52:30 user nova-compute[75095]:       </nova:ports>
Nov 15 15:52:30 user nova-compute[75095]:     </nova:instance>
Nov 15 15:52:30 user nova-compute[75095]:   </metadata>
Nov 15 15:52:30 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:52:30 user nova-compute[75095]:     <system>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="serial">bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</entry>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="uuid">bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1</entry>
Nov 15 15:52:30 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:52:30 user nova-compute[75095]:     </system>
Nov 15 15:52:30 user nova-compute[75095]:   </sysinfo>
Nov 15 15:52:30 user nova-compute[75095]:   <os>
Nov 15 15:52:30 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:52:30 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:52:30 user nova-compute[75095]:   </os>
Nov 15 15:52:30 user nova-compute[75095]:   <features>
Nov 15 15:52:30 user nova-compute[75095]:     <acpi/>
Nov 15 15:52:30 user nova-compute[75095]:     <apic/>
Nov 15 15:52:30 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:52:30 user nova-compute[75095]:   </features>
Nov 15 15:52:30 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:52:30 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:52:30 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:52:30 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:52:30 user nova-compute[75095]:   </clock>
Nov 15 15:52:30 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:52:30 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:52:30 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:52:30 user nova-compute[75095]:   </cpu>
Nov 15 15:52:30 user nova-compute[75095]:   <devices>
Nov 15 15:52:30 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:52:30 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:52:30 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue"/>
Nov 15 15:52:30 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:52:30 user nova-compute[75095]:     </disk>
Nov 15 15:52:30 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:52:30 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:52:30 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk"/>
Nov 15 15:52:30 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:52:30 user nova-compute[75095]:     </disk>
Nov 15 15:52:30 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:52:30 user nova-compute[75095]:       <mac address="fa:16:3e:26:93:5e"/>
Nov 15 15:52:30 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:30 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:52:30 user nova-compute[75095]:       <target dev="tapcc369ea8-46"/>
Nov 15 15:52:30 user nova-compute[75095]:     </interface>
Nov 15 15:52:30 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:52:30 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/console.log" append="off"/>
Nov 15 15:52:30 user nova-compute[75095]:     </serial>
Nov 15 15:52:30 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:52:30 user nova-compute[75095]:     <video>
Nov 15 15:52:30 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:52:30 user nova-compute[75095]:     </video>
Nov 15 15:52:30 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:52:30 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:52:30 user nova-compute[75095]:     </rng>
Nov 15 15:52:30 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:52:30 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:52:30 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:52:30 user nova-compute[75095]:     </memballoon>
Nov 15 15:52:30 user nova-compute[75095]:   </devices>
Nov 15 15:52:30 user nova-compute[75095]: </domain>
Nov 15 15:52:30 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:52:30 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance destroyed successfully.
Nov 15 15:52:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:26:93:5e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:52:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:31 user nova-compute[75095]: WARNING nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:31 user nova-compute[75095]: WARNING nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:31 user nova-compute[75095]: WARNING nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:31 user nova-compute[75095]: WARNING nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:31 user nova-compute[75095]: WARNING nova.compute.manager [req-8f676e89-9a2d-4e1e-8cc6-082df3654cc9 req-1f8b216a-d30b-4e4a-983c-a7590e35461e service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:33 user nova-compute[75095]: WARNING nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:52:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:52:33 user nova-compute[75095]: WARNING nova.compute.manager [req-9e5efc79-6b8f-4331-8c15-5330bf739b3b req-6d678a5c-4f12-4b30-8cde-d72baa4a8753 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state active and task_state rescuing.
Nov 15 15:52:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d9032105-9abf-4b15-a700-db92ffd02882 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:52:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:52:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:05 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:53:05 user nova-compute[75095]: INFO nova.compute.claims [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Claim successful on node user
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:53:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.policy [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122adc4dbe90486f8eed85dce6910d4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '846a2bf6258b4e8eab8705b70442b9f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:53:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Creating image(s)
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "/opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "/opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "/opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk 1073741824" returned: 0 in 0.050s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Checking if we can resize image /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Successfully created port: 2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Cannot resize image /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Ensure instance console log exists: /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Successfully updated port: 2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquired lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-changed-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Refreshing instance network info cache due to event network-changed-2790c9fb-a2e5-4d84-8839-d9521407ee7f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] Acquiring lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updating instance_info_cache with network_info: [{"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Releasing lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Instance network_info: |[{"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] Acquired lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Refreshing network info cache for port 2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Start _get_guest_xml network_info=[{"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:53:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1620545443',display_name='tempest-VolumesSnapshotTestJSON-instance-1620545443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1620545443',id=31,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuSeRZEOjvOrTOYT0D+WCFVSwieQTOraPG/50kvBQADrcn/w4Pusdo+7pSOcXQXmzFYGAWyPrgaPOMlEPSs/uIhlMoR+JqiT6FMCs3NRl9/0/GklJxgcjY4QMk+BVkMzw==',key_name='tempest-keypair-1853719728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-m4kz5qfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=33eedd67-b9a6-492f-a536-06850ed0752c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'pci_devices' on Instance uuid 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:53:07 user nova-compute[75095]:   <uuid>33eedd67-b9a6-492f-a536-06850ed0752c</uuid>
Nov 15 15:53:07 user nova-compute[75095]:   <name>instance-0000001f</name>
Nov 15 15:53:07 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:53:07 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:53:07 user nova-compute[75095]:   <metadata>
Nov 15 15:53:07 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:53:07 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1620545443</nova:name>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:53:07</nova:creationTime>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:53:07 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:53:07 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:owner>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:user uuid="122adc4dbe90486f8eed85dce6910d4f">tempest-VolumesSnapshotTestJSON-1176209995-project-member</nova:user>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:project uuid="846a2bf6258b4e8eab8705b70442b9f8">tempest-VolumesSnapshotTestJSON-1176209995</nova:project>
Nov 15 15:53:07 user nova-compute[75095]:       </nova:owner>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:53:07 user nova-compute[75095]:       <nova:ports>
Nov 15 15:53:07 user nova-compute[75095]:         <nova:port uuid="2790c9fb-a2e5-4d84-8839-d9521407ee7f">
Nov 15 15:53:07 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 15:53:07 user nova-compute[75095]:         </nova:port>
Nov 15 15:53:07 user nova-compute[75095]:       </nova:ports>
Nov 15 15:53:07 user nova-compute[75095]:     </nova:instance>
Nov 15 15:53:07 user nova-compute[75095]:   </metadata>
Nov 15 15:53:07 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:53:07 user nova-compute[75095]:     <system>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="serial">33eedd67-b9a6-492f-a536-06850ed0752c</entry>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="uuid">33eedd67-b9a6-492f-a536-06850ed0752c</entry>
Nov 15 15:53:07 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:53:07 user nova-compute[75095]:     </system>
Nov 15 15:53:07 user nova-compute[75095]:   </sysinfo>
Nov 15 15:53:07 user nova-compute[75095]:   <os>
Nov 15 15:53:07 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:53:07 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:53:07 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:53:07 user nova-compute[75095]:   </os>
Nov 15 15:53:07 user nova-compute[75095]:   <features>
Nov 15 15:53:07 user nova-compute[75095]:     <acpi/>
Nov 15 15:53:07 user nova-compute[75095]:     <apic/>
Nov 15 15:53:07 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:53:07 user nova-compute[75095]:   </features>
Nov 15 15:53:07 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:53:07 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:53:07 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:53:07 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:53:07 user nova-compute[75095]:   </clock>
Nov 15 15:53:07 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:53:07 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:53:07 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:53:07 user nova-compute[75095]:   </cpu>
Nov 15 15:53:07 user nova-compute[75095]:   <devices>
Nov 15 15:53:07 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:53:07 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:53:07 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk"/>
Nov 15 15:53:07 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:53:07 user nova-compute[75095]:     </disk>
Nov 15 15:53:07 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:53:07 user nova-compute[75095]:       <mac address="fa:16:3e:bd:b0:92"/>
Nov 15 15:53:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:07 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:53:07 user nova-compute[75095]:       <target dev="tap2790c9fb-a2"/>
Nov 15 15:53:07 user nova-compute[75095]:     </interface>
Nov 15 15:53:07 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:53:07 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/console.log" append="off"/>
Nov 15 15:53:07 user nova-compute[75095]:     </serial>
Nov 15 15:53:07 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:53:07 user nova-compute[75095]:     <video>
Nov 15 15:53:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:07 user nova-compute[75095]:     </video>
Nov 15 15:53:07 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:53:07 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:53:07 user nova-compute[75095]:     </rng>
Nov 15 15:53:07 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:53:07 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:53:07 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:53:07 user nova-compute[75095]:     </memballoon>
Nov 15 15:53:07 user nova-compute[75095]:   </devices>
Nov 15 15:53:07 user nova-compute[75095]: </domain>
Nov 15 15:53:07 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1620545443',display_name='tempest-VolumesSnapshotTestJSON-instance-1620545443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1620545443',id=31,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuSeRZEOjvOrTOYT0D+WCFVSwieQTOraPG/50kvBQADrcn/w4Pusdo+7pSOcXQXmzFYGAWyPrgaPOMlEPSs/uIhlMoR+JqiT6FMCs3NRl9/0/GklJxgcjY4QMk+BVkMzw==',key_name='tempest-keypair-1853719728',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-m4kz5qfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=33eedd67-b9a6-492f-a536-06850ed0752c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG os_vif [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbb6ef33-5ac4-5f04-99b9-f179ddbe661b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2790c9fb-a2, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2790c9fb-a2, col_values=(('qos', UUID('9689ea51-62cd-4a69-96d8-9ce5d4a82468')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2790c9fb-a2, col_values=(('external_ids', {'iface-id': '2790c9fb-a2e5-4d84-8839-d9521407ee7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:b0:92', 'vm-uuid': '33eedd67-b9a6-492f-a536-06850ed0752c'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:08 user nova-compute[75095]: INFO os_vif [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2')
Nov 15 15:53:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No VIF found with MAC fa:16:3e:bd:b0:92, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updated VIF entry in instance network info cache for port 2790c9fb-a2e5-4d84-8839-d9521407ee7f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG nova.network.neutron [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updating instance_info_cache with network_info: [{"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-574059cb-117a-451f-bbc7-1d7485158900 req-a38ca5c9-2f33-4b27-baa4-807b029be29c service nova] Releasing lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] No waiting events found dispatching network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:09 user nova-compute[75095]: WARNING nova.compute.manager [req-029f9b27-70b9-41c7-88ca-bcc149d7a84c req-20a80263-bae1-4a68-860f-398a157486f3 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received unexpected event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f for instance with vm_state building and task_state spawning.
Nov 15 15:53:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:53:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Instance spawned successfully.
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:11 user nova-compute[75095]: INFO nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] No waiting events found dispatching network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:11 user nova-compute[75095]: WARNING nova.compute.manager [req-290c44a1-1c05-4549-8df6-0a5c3cb6af71 req-87722792-684e-4298-a2af-2e2159c334a7 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received unexpected event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f for instance with vm_state building and task_state spawning.
Nov 15 15:53:11 user nova-compute[75095]: INFO nova.compute.manager [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Took 5.98 seconds to build instance.
Nov 15 15:53:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-496fe03b-f785-4b43-bbb4-2cbcb9e8938c tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.075s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:53:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 15:53:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:53:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:53:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:53:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:21 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7419MB free_disk=24.46384048461914GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 33eedd67-b9a6-492f-a536-06850ed0752c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:53:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 15:53:22 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 15:53:22 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:53:22 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:53:22 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:53:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:53:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-changed-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] [instance: b9836a76-0313-4058-857f-777075521311] Refreshing instance network info cache due to event network-changed-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] Acquiring lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] Acquired lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] [instance: b9836a76-0313-4058-857f-777075521311] Refreshing network info cache for port ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] [instance: b9836a76-0313-4058-857f-777075521311] Updated VIF entry in instance network info cache for port ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG nova.network.neutron [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] [instance: b9836a76-0313-4058-857f-777075521311] Updating instance_info_cache with network_info: [{"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-957aaffb-0569-4eec-8519-d3d58726d680 req-99fa61f6-c578-4ea3-9514-ac7b3addb709 service nova] Releasing lock "refresh_cache-b9836a76-0313-4058-857f-777075521311" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'flavor' on Instance uuid b9836a76-0313-4058-857f-777075521311 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:38 user nova-compute[75095]: INFO nova.compute.manager [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Attaching volume 78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 to /dev/vdb
Nov 15 15:53:38 user nova-compute[75095]: DEBUG os_brick.utils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365f69f-e338-40c2-94fd-37d77b8040c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8786cb08-85e4-4e78-bfdc-a63371b5eb11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d37dd7-e648-44eb-ba72-b2ec96d3ba27]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e999090-27ad-41e9-895f-e8e3cdce99e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:53:39 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:53:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665f342-9958-4879-80e6-1b26c1e615a1]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG os_brick.utils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:53:39 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Updating existing volume attachment record: e0cbc34f-c516-493a-b280-40b80d4e9bc1 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:53:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODenHXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:53:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:53:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:53:45 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5e8dd-56c0-4622-a0fb-7ecdcb9bf849]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:53:45 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa31d8b-f2b1-41d4-a454-de2efb11ae1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8] added
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7ff255-124d-4e1e-9e02-eb078e750403]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba178bc6-3074-4f7d-a03d-31f1792aa4dc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODenHXEs {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ODenHXEs" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[19089539-4669-4f7a-ac34-efae894676ad]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ODenHXEs'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[335622e1-6417-4db4-8a9b-952a8f83ad5f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9fd9b4-b2ea-46c1-b148-ce5d80201aad]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56cdbe-2087-4f15-b30f-230ad6550c61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260]
Nov 15 15:53:45 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260] successful.
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e83ff1-6e8b-4d2b-829e-e7b3b070bfdb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b90832-e599-4cbc-9aad-a4693f21fb66]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007f912-7ced-4cc2-98d9-04d38ce3e8e9]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:53:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODenHXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26139346266643463', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139346266643463', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'flavor' on Instance uuid b9836a76-0313-4058-857f-777075521311 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:53:46 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:53:46 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:53:46 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:53:46 user nova-compute[75095]:   <serial>78f00fdc-0ee0-4eba-bd2f-2f2a843159b8</serial>
Nov 15 15:53:46 user nova-compute[75095]: </disk>
Nov 15 15:53:46 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:46 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:53:46 user nova-compute[75095]: INFO nova.compute.claims [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Claim successful on node user
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No VIF found with MAC fa:16:3e:4c:92:f5, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1fae5368-61e4-463a-9d08-6c610fa66eab tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.390s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:53:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:53:47 user nova-compute[75095]: INFO nova.virt.block_device [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Booting with volume 53c59e98-65e8-4447-bcb4-52253fecafe1 at /dev/vda
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.policy [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '975ca4994eb74b6bbf541bb308b148f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18c587b1467441ceb091ece4e973408e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.utils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[931390f2-ce81-48e9-a95b-92b4f58a1201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7711f36-06bd-46d8-b29c-a5dfa3012ddf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4046ad-b63e-4802-9297-edea55963bb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd7a5b-75fb-4ce4-8688-52d9c7e41bc4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:53:47 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:53:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee4e85-ad0f-4acf-ac4d-25eaa0439936]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG os_brick.utils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:53:47 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating existing volume attachment record: eaa65c0f-e5ca-4cba-bf2b-1c7a3c46e41b {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:48 user nova-compute[75095]: INFO nova.compute.manager [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Detaching volume 78f00fdc-0ee0-4eba-bd2f-2f2a843159b8
Nov 15 15:53:48 user nova-compute[75095]: INFO nova.virt.block_device [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Attempting to driver detach volume 78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 from mountpoint /dev/vdb
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Attempting to detach device vdb from instance b9836a76-0313-4058-857f-777075521311 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:53:48 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:53:48 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:53:48 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:53:48 user nova-compute[75095]:   <serial>78f00fdc-0ee0-4eba-bd2f-2f2a843159b8</serial>
Nov 15 15:53:48 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:53:48 user nova-compute[75095]: </disk>
Nov 15 15:53:48 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:53:48 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully detached device vdb from instance b9836a76-0313-4058-857f-777075521311 from the persistent domain config.
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9836a76-0313-4058-857f-777075521311 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:53:48 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:53:48 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:53:48 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:53:48 user nova-compute[75095]:   <serial>78f00fdc-0ee0-4eba-bd2f-2f2a843159b8</serial>
Nov 15 15:53:48 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:53:48 user nova-compute[75095]: </disk>
Nov 15 15:53:48 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Successfully created port: da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9836a76-0313-4058-857f-777075521311 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Successfully updated port: da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-changed-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Refreshing instance network info cache due to event network-changed-da912a65-e75f-4457-8721-8e8cb7fc5065. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance network_info: |[{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Refreshing network info cache for port da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updated VIF entry in instance network info cache for port da912a65-e75f-4457-8721-8e8cb7fc5065. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e481387f-121f-4312-886c-171b04d8dfec req-995e47b4-c6a2-4c2c-8db0-5996af144385 service nova] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-changed-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Refreshing instance network info cache due to event network-changed-e517354d-bf9e-42a7-a300-cfb9822959c3. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] Acquiring lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] Acquired lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Refreshing network info cache for port e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updated VIF entry in instance network info cache for port e517354d-bf9e-42a7-a300-cfb9822959c3. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.network.neutron [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updating instance_info_cache with network_info: [{"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ab428915-0f1a-4b32-832b-c5b1c29f16e3 req-c6476dae-44e5-43aa-a241-4804824b254f service nova] Releasing lock "refresh_cache-9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:53:52 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Creating image(s)
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start _get_guest_xml network_info=[{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'eaa65c0f-e5ca-4cba-bf2b-1c7a3c46e41b', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c63a3174-966d-4ce8-95c3-53a8b817a2a3', 'attached_at': '', 'detached_at': '', 'volume_id': '53c59e98-65e8-4447-bcb4-52253fecafe1', 'serial': '53c59e98-65e8-4447-bcb4-52253fecafe1'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:53:52 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:52 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:53:52 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:53:52 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:53:52 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd3d3cf-2e10-4c4a-a075-93fb5d10f608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:53:52 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b2ae96-1b57-459d-8063-9c99faf685b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1] added
Nov 15 15:53:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[814c0818-7730-475c-ab0e-e3589cba3a8b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4889c2-f124-47fe-8955-21fe0d9eea5f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeFNWxSX {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeFNWxSX" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[285cdea0-3ec4-4b4a-a6c2-ecde373bdc3b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeFNWxSX'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf3b4b3-b902-4af5-b90b-701cfd7bc252]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbf4362-303f-4f1c-ad27-efe988b15046]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b33b6e-8c3e-4d9d-8493-acf99397391c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]
Nov 15 15:53:53 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.
Nov 15 15:53:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[915e3a0d-3956-4081-b2f1-a2dec4fa7e1c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b401cb-1c2f-45c4-92e0-cd3d9c54be11]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:53:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa6d7c-101e-4c0f-9f18-41fbf1029079]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:53 user nova-compute[75095]: INFO nova.compute.manager [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Terminating instance
Nov 15 15:53:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-016537f9-183f-44f1-8c5e-1caf7abc4678 req-6abdc9d2-121b-4844-9a30-5f6d99428d41 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23034613764363033', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034613764363033', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'pci_devices' on Instance uuid c63a3174-966d-4ce8-95c3-53a8b817a2a3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:53:54 user nova-compute[75095]:   <uuid>c63a3174-966d-4ce8-95c3-53a8b817a2a3</uuid>
Nov 15 15:53:54 user nova-compute[75095]:   <name>instance-00000020</name>
Nov 15 15:53:54 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:53:54 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:53:54 user nova-compute[75095]:   <metadata>
Nov 15 15:53:54 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:53:54 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:53:54 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherA-server-831689889</nova:name>
Nov 15 15:53:54 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:53:52</nova:creationTime>
Nov 15 15:53:54 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:53:54 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:53:54 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:53:54 user nova-compute[75095]:       <nova:owner>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:user uuid="975ca4994eb74b6bbf541bb308b148f1">tempest-ServerActionsTestOtherA-440053215-project-member</nova:user>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:project uuid="18c587b1467441ceb091ece4e973408e">tempest-ServerActionsTestOtherA-440053215</nova:project>
Nov 15 15:53:54 user nova-compute[75095]:       </nova:owner>
Nov 15 15:53:54 user nova-compute[75095]:       <nova:ports>
Nov 15 15:53:54 user nova-compute[75095]:         <nova:port uuid="da912a65-e75f-4457-8721-8e8cb7fc5065">
Nov 15 15:53:54 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:53:54 user nova-compute[75095]:         </nova:port>
Nov 15 15:53:54 user nova-compute[75095]:       </nova:ports>
Nov 15 15:53:54 user nova-compute[75095]:     </nova:instance>
Nov 15 15:53:54 user nova-compute[75095]:   </metadata>
Nov 15 15:53:54 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:53:54 user nova-compute[75095]:     <system>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="serial">c63a3174-966d-4ce8-95c3-53a8b817a2a3</entry>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="uuid">c63a3174-966d-4ce8-95c3-53a8b817a2a3</entry>
Nov 15 15:53:54 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:53:54 user nova-compute[75095]:     </system>
Nov 15 15:53:54 user nova-compute[75095]:   </sysinfo>
Nov 15 15:53:54 user nova-compute[75095]:   <os>
Nov 15 15:53:54 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:53:54 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:53:54 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:53:54 user nova-compute[75095]:   </os>
Nov 15 15:53:54 user nova-compute[75095]:   <features>
Nov 15 15:53:54 user nova-compute[75095]:     <acpi/>
Nov 15 15:53:54 user nova-compute[75095]:     <apic/>
Nov 15 15:53:54 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:53:54 user nova-compute[75095]:   </features>
Nov 15 15:53:54 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:53:54 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:53:54 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:53:54 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:53:54 user nova-compute[75095]:   </clock>
Nov 15 15:53:54 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:53:54 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:53:54 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:53:54 user nova-compute[75095]:   </cpu>
Nov 15 15:53:54 user nova-compute[75095]:   <devices>
Nov 15 15:53:54 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:53:54 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:53:54 user nova-compute[75095]:       <source dev="/dev/sde"/>
Nov 15 15:53:54 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:53:54 user nova-compute[75095]:       <serial>53c59e98-65e8-4447-bcb4-52253fecafe1</serial>
Nov 15 15:53:54 user nova-compute[75095]:     </disk>
Nov 15 15:53:54 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:53:54 user nova-compute[75095]:       <mac address="fa:16:3e:d1:11:75"/>
Nov 15 15:53:54 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:54 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:53:54 user nova-compute[75095]:       <target dev="tapda912a65-e7"/>
Nov 15 15:53:54 user nova-compute[75095]:     </interface>
Nov 15 15:53:54 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:53:54 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3/console.log" append="off"/>
Nov 15 15:53:54 user nova-compute[75095]:     </serial>
Nov 15 15:53:54 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:53:54 user nova-compute[75095]:     <video>
Nov 15 15:53:54 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:54 user nova-compute[75095]:     </video>
Nov 15 15:53:54 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:53:54 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:53:54 user nova-compute[75095]:     </rng>
Nov 15 15:53:54 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:53:54 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:53:54 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:53:54 user nova-compute[75095]:     </memballoon>
Nov 15 15:53:54 user nova-compute[75095]:   </devices>
Nov 15 15:53:54 user nova-compute[75095]: </domain>
Nov 15 15:53:54 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_vif [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86785b53-13f7-5077-bce3-b94652f18e5d', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda912a65-e7, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda912a65-e7, col_values=(('qos', UUID('9ff9acc7-e4bc-440c-a604-ddd55ea669c9')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda912a65-e7, col_values=(('external_ids', {'iface-id': 'da912a65-e75f-4457-8721-8e8cb7fc5065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:11:75', 'vm-uuid': 'c63a3174-966d-4ce8-95c3-53a8b817a2a3'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: INFO os_vif [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7')
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:d1:11:75, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Instance destroyed successfully.
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.objects.instance [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-421188492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-421188492',id=29,image_ref='71c22a35-456a-47d1-86fc-c8c99259d601',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyyGqvIKtW93EC3kWPVdd+GgjOuw4rejsHFgTEEC1YIaYEjkb1E6/+nGVEWtufEyG32A7ux3raeFmPGpzGDy3cw4+nqAAmbvoABQ0TsIQPBGpAhkR+1OTjcqn/UXK6Wyg==',key_name='tempest-keypair-1266206588',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:52:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-zj593p0z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108978395',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:52:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9c6915a4-d62e-47ea-81f9-1b85e6e6e52d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e517354d-bf9e-42a7-a300-cfb9822959c3", "address": "fa:16:3e:7e:2e:e8", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape517354d-bf", "ovs_interfaceid": "e517354d-bf9e-42a7-a300-cfb9822959c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_vif [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape517354d-bf, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b609046f-8a08-4218-b07c-19c2a1002a26) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:54 user nova-compute[75095]: INFO os_vif [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:2e:e8,bridge_name='br-int',has_traffic_filtering=True,id=e517354d-bf9e-42a7-a300-cfb9822959c3,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape517354d-bf')
Nov 15 15:53:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqlRfvnW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:53:54 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d582b-fcc2-4b3a-8496-15cd02364a1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:53:54 user nova-compute[75095]: No targets found.
Nov 15 15:53:54 user nova-compute[75095]: iSNS:
Nov 15 15:53:54 user nova-compute[75095]: No targets found.
Nov 15 15:53:54 user nova-compute[75095]: STATIC:
Nov 15 15:53:54 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71
Nov 15 15:53:54 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:53:54 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:53:54 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:53:54 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:53:54 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:53:54 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:53:54 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:53:54 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:53:54 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:53:54 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:53:54 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:53:54 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8
Nov 15 15:53:54 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:53:54 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:53:54 user nova-compute[75095]: FIRMWARE:
Nov 15 15:53:54 user nova-compute[75095]: No targets found.
Nov 15 15:53:54 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:53:54 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:53:54 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:53:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca86cdce-1ee9-4632-bbe2-1631ae508f94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62771c6-ee06-4b67-aeb6-c1d9db675d71]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:53:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2724d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4bc63-22c4-4971-b02e-7c519d8e2cda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee53764-1a83-4fbe-94b8-80b459396932]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[079774ac-3a8b-47ff-b354-bddfe0dd3860]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:53:55 user nova-compute[75095]: INFO nova.compute.claims [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Claim successful on node user
Nov 15 15:53:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2caab432-2ebf-40e1-b7f3-6e6fee57831b]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1604c755-c467-48ff-9d34-8237c16302a7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086a063-9c5d-4265-bfd3-9c99c0db0d3c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260]
Nov 15 15:53:55 user nova-compute[75095]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71, portal: 172.16.0.220,3260] successful.
Nov 15 15:53:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:678287ea-e465-4391-9b98-b5c1fc713d71 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d230b582-485e-486c-a50f-d1a7e5353faf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (366ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:53:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Deleting instance files /opt/stack/data/nova/instances/9c6915a4-d62e-47ea-81f9-1b85e6e6e52d_del
Nov 15 15:53:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Deletion of /opt/stack/data/nova/instances/9c6915a4-d62e-47ea-81f9-1b85e6e6e52d_del complete
Nov 15 15:53:55 user nova-compute[75095]: INFO nova.compute.manager [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Took 1.66 seconds to destroy the instance on the hypervisor.
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:53:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: WARNING nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state active and task_state deleting.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: WARNING nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state active and task_state deleting.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: WARNING nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state active and task_state deleting.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-unplugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Acquiring lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] No waiting events found dispatching network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: WARNING nova.compute.manager [req-ff25da63-97bd-40fc-bfc7-bad137296e9b req-2bb9986f-e355-4279-854e-f4773d3fdfca service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received unexpected event network-vif-plugged-e517354d-bf9e-42a7-a300-cfb9822959c3 for instance with vm_state active and task_state deleting.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.policy [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e464dcfa23814b2798c8738730374dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146bfea92e9f4bf3b6996aac094f9e43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:53:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Creating image(s)
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:56 user nova-compute[75095]: WARNING nova.compute.manager [req-9925870b-3905-4bee-b6dd-819cc0a83b9f req-38e001b8-f9b4-4209-8464-8e2f10d605a0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state building and task_state spawning.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk 1073741824" returned: 0 in 0.054s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:56 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Took 1.51 seconds to deallocate network for instance.
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Cannot resize image /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Ensure instance console log exists: /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Successfully created port: 95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Successfully updated port: 95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:53:57 user nova-compute[75095]: INFO nova.compute.manager [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Took 0.77 seconds to detach 1 volumes for instance.
Nov 15 15:53:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Deleting volume: 678287ea-e465-4391-9b98-b5c1fc713d71 {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:53:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance spawned successfully.
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Updating instance_info_cache with network_info: [{"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Instance network_info: |[{"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Start _get_guest_xml network_info=[{"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:53:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:53:58 user nova-compute[75095]: INFO nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-63914110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-63914110',id=33,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-rufm04gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:56Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=7ba34aca-dade-4f88-bdda-c8b4837f87aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ba34aca-dade-4f88-bdda-c8b4837f87aa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:53:58 user nova-compute[75095]:   <uuid>7ba34aca-dade-4f88-bdda-c8b4837f87aa</uuid>
Nov 15 15:53:58 user nova-compute[75095]:   <name>instance-00000021</name>
Nov 15 15:53:58 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:53:58 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:53:58 user nova-compute[75095]:   <metadata>
Nov 15 15:53:58 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:53:58 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-63914110</nova:name>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:53:58</nova:creationTime>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:53:58 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:53:58 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:owner>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:53:58 user nova-compute[75095]:       </nova:owner>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:53:58 user nova-compute[75095]:       <nova:ports>
Nov 15 15:53:58 user nova-compute[75095]:         <nova:port uuid="95a5dd21-f300-4c4f-b4dd-c386ea5afe37">
Nov 15 15:53:58 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 15:53:58 user nova-compute[75095]:         </nova:port>
Nov 15 15:53:58 user nova-compute[75095]:       </nova:ports>
Nov 15 15:53:58 user nova-compute[75095]:     </nova:instance>
Nov 15 15:53:58 user nova-compute[75095]:   </metadata>
Nov 15 15:53:58 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:53:58 user nova-compute[75095]:     <system>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="serial">7ba34aca-dade-4f88-bdda-c8b4837f87aa</entry>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="uuid">7ba34aca-dade-4f88-bdda-c8b4837f87aa</entry>
Nov 15 15:53:58 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:53:58 user nova-compute[75095]:     </system>
Nov 15 15:53:58 user nova-compute[75095]:   </sysinfo>
Nov 15 15:53:58 user nova-compute[75095]:   <os>
Nov 15 15:53:58 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:53:58 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:53:58 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:53:58 user nova-compute[75095]:   </os>
Nov 15 15:53:58 user nova-compute[75095]:   <features>
Nov 15 15:53:58 user nova-compute[75095]:     <acpi/>
Nov 15 15:53:58 user nova-compute[75095]:     <apic/>
Nov 15 15:53:58 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:53:58 user nova-compute[75095]:   </features>
Nov 15 15:53:58 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:53:58 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:53:58 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:53:58 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:53:58 user nova-compute[75095]:   </clock>
Nov 15 15:53:58 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:53:58 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:53:58 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:53:58 user nova-compute[75095]:   </cpu>
Nov 15 15:53:58 user nova-compute[75095]:   <devices>
Nov 15 15:53:58 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:53:58 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:53:58 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk"/>
Nov 15 15:53:58 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:53:58 user nova-compute[75095]:     </disk>
Nov 15 15:53:58 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:53:58 user nova-compute[75095]:       <mac address="fa:16:3e:d2:9e:0f"/>
Nov 15 15:53:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:58 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:53:58 user nova-compute[75095]:       <target dev="tap95a5dd21-f3"/>
Nov 15 15:53:58 user nova-compute[75095]:     </interface>
Nov 15 15:53:58 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:53:58 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/console.log" append="off"/>
Nov 15 15:53:58 user nova-compute[75095]:     </serial>
Nov 15 15:53:58 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:53:58 user nova-compute[75095]:     <video>
Nov 15 15:53:58 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:53:58 user nova-compute[75095]:     </video>
Nov 15 15:53:58 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:53:58 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:53:58 user nova-compute[75095]:     </rng>
Nov 15 15:53:58 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:53:58 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:53:58 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:53:58 user nova-compute[75095]:     </memballoon>
Nov 15 15:53:58 user nova-compute[75095]:   </devices>
Nov 15 15:53:58 user nova-compute[75095]: </domain>
Nov 15 15:53:58 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-63914110',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-63914110',id=33,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-rufm04gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:53:56Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=7ba34aca-dade-4f88-bdda-c8b4837f87aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG os_vif [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d1dae78-c755-5d96-b080-3233db0cc36c', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95a5dd21-f3, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95a5dd21-f3, col_values=(('qos', UUID('084936bf-8f39-4558-b752-f29765bc30b5')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95a5dd21-f3, col_values=(('external_ids', {'iface-id': '95a5dd21-f300-4c4f-b4dd-c386ea5afe37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:9e:0f', 'vm-uuid': '7ba34aca-dade-4f88-bdda-c8b4837f87aa'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:53:58 user nova-compute[75095]: INFO nova.compute.manager [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Took 11.42 seconds to build instance.
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:58 user nova-compute[75095]: INFO os_vif [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3')
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8159cf48-a54d-42d8-b2a9-7b888154a979 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.524s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:d2:9e:0f, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:53:58 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-04e921ac-fc44-4ff1-bbd4-2a4cb17c48f7 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9c6915a4-d62e-47ea-81f9-1b85e6e6e52d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.827s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 9c6915a4-d62e-47ea-81f9-1b85e6e6e52d] Received event network-vif-deleted-e517354d-bf9e-42a7-a300-cfb9822959c3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:53:58 user nova-compute[75095]: WARNING nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state active and task_state None.
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-changed-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Refreshing instance network info cache due to event network-changed-95a5dd21-f300-4c4f-b4dd-c386ea5afe37. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Acquiring lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Acquired lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Refreshing network info cache for port 95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-changed-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Refreshing instance network info cache due to event network-changed-98eb3d10-702d-4bc6-9630-91d167a5b06c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] Acquiring lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] Acquired lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Refreshing network info cache for port 98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Updated VIF entry in instance network info cache for port 95a5dd21-f300-4c4f-b4dd-c386ea5afe37. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Updating instance_info_cache with network_info: [{"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbc79148-3372-473b-ad76-fb7aeaff5290 req-10f1c354-4308-43ad-aa2f-3c6e343adb63 service nova] Releasing lock "refresh_cache-7ba34aca-dade-4f88-bdda-c8b4837f87aa" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updated VIF entry in instance network info cache for port 98eb3d10-702d-4bc6-9630-91d167a5b06c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating instance_info_cache with network_info: [{"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:53:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-246579eb-b866-4a98-912d-e3a009857210 req-a8cf773e-f4ca-4ebd-ba80-480917298288 service nova] Releasing lock "refresh_cache-7e5b52ab-eebc-4194-b588-7b688f7f2ba3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] No waiting events found dispatching network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:00 user nova-compute[75095]: WARNING nova.compute.manager [req-da54886f-e580-4fb2-8412-06080fe2bdad req-507f3009-62a6-4a2d-8a95-e70cee0a7e4e service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received unexpected event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 for instance with vm_state building and task_state spawning.
Nov 15 15:54:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:54:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Instance spawned successfully.
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] No waiting events found dispatching network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:02 user nova-compute[75095]: WARNING nova.compute.manager [req-e1d9261c-d0f1-43b1-9174-a64b59c95e47 req-10a3e12a-9a93-4a32-8ec6-e248f2a588d4 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received unexpected event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 for instance with vm_state building and task_state spawning.
Nov 15 15:54:02 user nova-compute[75095]: INFO nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 15 15:54:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:54:02 user nova-compute[75095]: INFO nova.compute.manager [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Took 7.16 seconds to build instance.
Nov 15 15:54:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3fb70066-9337-466b-ab50-b498759a77bf tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.294s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:03 user nova-compute[75095]: INFO nova.compute.manager [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attaching volume 01328b6f-ad8c-4508-b1e6-6bcc91d7199c to /dev/vdb
Nov 15 15:54:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.utils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4115692e-119e-4ff8-be39-9b4cf65a0880]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[547440fb-a99f-4dfd-a4bf-ca1c42846e6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2e32bd-586c-4a58-aa46-512e7e605de6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3dae22-c8b7-476e-802e-525413f579da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:54:03 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:54:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa0fbe-bc92-47a2-9ab5-82b586b7a02a]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG os_brick.utils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating existing volume attachment record: 79dd6b21-e59a-4964-9d12-bde554188f3a {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:54:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:08 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b9836a76-0313-4058-857f-777075521311 is timed out.
Nov 15 15:54:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully detached device vdb from instance b9836a76-0313-4058-857f-777075521311 from the live domain config.
Nov 15 15:54:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ODenHXEs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgquTsSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2d107-0443-4abc-948f-9636da6df5a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:54:08 user nova-compute[75095]: No targets found.
Nov 15 15:54:08 user nova-compute[75095]: iSNS:
Nov 15 15:54:08 user nova-compute[75095]: No targets found.
Nov 15 15:54:08 user nova-compute[75095]: STATIC:
Nov 15 15:54:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:54:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:54:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:54:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:08 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8
Nov 15 15:54:08 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:08 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:08 user nova-compute[75095]: FIRMWARE:
Nov 15 15:54:08 user nova-compute[75095]: No targets found.
Nov 15 15:54:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:54:08 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:54:08 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d2028-512a-4780-b545-aeeeef7c851a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb05f8e-4025-4f9c-be55-ba4ba16284a8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595ff4e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad1fb03-cefe-4d8d-85a3-a873ea963e08]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc37f73-6209-4394-9a8a-f92d331e7007]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2db00-8715-4b6a-9c93-0d0f7808eb06]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10256aa-a4ab-49f1-b2f8-7e2b0d6d3f9f]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbac245-9ae8-422a-9b99-36217ee441cd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.144s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c8f0b4-0e66-4805-8c03-ac07efd11a8a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260]
Nov 15 15:54:09 user nova-compute[75095]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8, portal: 172.16.0.220,3260] successful.
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78f00fdc-0ee0-4eba-bd2f-2f2a843159b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4867983-482e-4df7-a300-a1cbfd895a0c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] <== disconnect_volume: return (422ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.397s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:54:09 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:54:09 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[545b3185-e21c-4fd5-b99f-02623fc58b18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:54:09 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a421442f-96a0-4cbe-9a56-165c5af79027]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c] added
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05086f4-13ba-45b0-a8f6-f1e76d31b227]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0dde95-b7d6-4d02-90f2-101355ba1472]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgquTsSp {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EgquTsSp" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ccea4f-03c2-4ee8-9f0e-c5be1bcd6d14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EgquTsSp'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d2f0c-1bdb-4c0d-916c-5ce705273aa2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32703c9-d0b4-47da-8d77-b2692863766f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee40451-8ad5-416a-bf80-84c37f6b926b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260]
Nov 15 15:54:09 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260] successful.
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fa8021-e7af-4f19-a553-1f249446f7f1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0ef84-8d58-4cb1-ba65-6268090ee4a1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:09 user nova-compute[75095]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)
Nov 15 15:54:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24493545-154d-40a8-a674-b1e57b107325]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgquTsSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'flavor' on Instance uuid b9836a76-0313-4058-857f-777075521311 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ddbd32b3-9fac-4c62-bf77-baf777db4f1e tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== connect_volume: return (1708ms) {'type': 'block', 'scsi_wwn': '26535333832316566', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535333832316566', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:54:10 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:54:10 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:54:10 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:54:10 user nova-compute[75095]:   <serial>01328b6f-ad8c-4508-b1e6-6bcc91d7199c</serial>
Nov 15 15:54:10 user nova-compute[75095]: </disk>
Nov 15 15:54:10 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No VIF found with MAC fa:16:3e:5e:69:d0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:54:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-377e3b9a-f917-44ab-962c-7ff2e0140f6b tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.702s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:54:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:54:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:54:14 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:54:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:54:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:54:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:54:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:21 user nova-compute[75095]: INFO nova.compute.manager [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Detaching volume 01328b6f-ad8c-4508-b1e6-6bcc91d7199c
Nov 15 15:54:21 user nova-compute[75095]: INFO nova.virt.block_device [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attempting to driver detach volume 01328b6f-ad8c-4508-b1e6-6bcc91d7199c from mountpoint /dev/vdb
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Attempting to detach device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:54:22 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:54:22 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:54:22 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:54:22 user nova-compute[75095]:   <serial>01328b6f-ad8c-4508-b1e6-6bcc91d7199c</serial>
Nov 15 15:54:22 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:54:22 user nova-compute[75095]: </disk>
Nov 15 15:54:22 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:54:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config.
Nov 15 15:54:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:54:22 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:54:22 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:54:22 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:54:22 user nova-compute[75095]:   <serial>01328b6f-ad8c-4508-b1e6-6bcc91d7199c</serial>
Nov 15 15:54:22 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:54:22 user nova-compute[75095]: </disk>
Nov 15 15:54:22 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:54:23 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:54:23 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7423MB free_disk=24.397247314453125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 33eedd67-b9a6-492f-a536-06850ed0752c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:54:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:54:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:54:39 user nova-compute[75095]: INFO nova.compute.claims [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Claim successful on node user
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:54:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:54:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.policy [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '07d584f2b0224d5aa6569a95556e0365', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc1e4e79a5944d438bfacae28fd86ada', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:54:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Creating image(s)
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "/opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "/opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "/opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Successfully created port: 2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk 1073741824" returned: 0 in 0.051s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Cannot resize image /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Ensure instance console log exists: /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Successfully updated port: 2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquired lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-changed-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Refreshing instance network info cache due to event network-changed-2dd1d029-e720-4479-ab6a-577ec387d424. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] Acquiring lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Updating instance_info_cache with network_info: [{"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Releasing lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Instance network_info: |[{"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] Acquired lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Refreshing network info cache for port 2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Start _get_guest_xml network_info=[{"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:54:41 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:54:41 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1459784465',display_name='tempest-VolumesAdminNegativeTest-server-1459784465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1459784465',id=34,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-0ihf2b04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:54:40Z,user_data=None,user_id='07d584f2b0224d5aa6569a95556e0365',uuid=f741ca0b-a41d-4b5b-91df-7e2606e28299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'pci_devices' on Instance uuid f741ca0b-a41d-4b5b-91df-7e2606e28299 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:54:41 user nova-compute[75095]:   <uuid>f741ca0b-a41d-4b5b-91df-7e2606e28299</uuid>
Nov 15 15:54:41 user nova-compute[75095]:   <name>instance-00000022</name>
Nov 15 15:54:41 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:54:41 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:54:41 user nova-compute[75095]:   <metadata>
Nov 15 15:54:41 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:54:41 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1459784465</nova:name>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:54:41</nova:creationTime>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:54:41 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:54:41 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:owner>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:user uuid="07d584f2b0224d5aa6569a95556e0365">tempest-VolumesAdminNegativeTest-1780720036-project-member</nova:user>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:project uuid="fc1e4e79a5944d438bfacae28fd86ada">tempest-VolumesAdminNegativeTest-1780720036</nova:project>
Nov 15 15:54:41 user nova-compute[75095]:       </nova:owner>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:54:41 user nova-compute[75095]:       <nova:ports>
Nov 15 15:54:41 user nova-compute[75095]:         <nova:port uuid="2dd1d029-e720-4479-ab6a-577ec387d424">
Nov 15 15:54:41 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 15:54:41 user nova-compute[75095]:         </nova:port>
Nov 15 15:54:41 user nova-compute[75095]:       </nova:ports>
Nov 15 15:54:41 user nova-compute[75095]:     </nova:instance>
Nov 15 15:54:41 user nova-compute[75095]:   </metadata>
Nov 15 15:54:41 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:54:41 user nova-compute[75095]:     <system>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="serial">f741ca0b-a41d-4b5b-91df-7e2606e28299</entry>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="uuid">f741ca0b-a41d-4b5b-91df-7e2606e28299</entry>
Nov 15 15:54:41 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:54:41 user nova-compute[75095]:     </system>
Nov 15 15:54:41 user nova-compute[75095]:   </sysinfo>
Nov 15 15:54:41 user nova-compute[75095]:   <os>
Nov 15 15:54:41 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:54:41 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:54:41 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:54:41 user nova-compute[75095]:   </os>
Nov 15 15:54:41 user nova-compute[75095]:   <features>
Nov 15 15:54:41 user nova-compute[75095]:     <acpi/>
Nov 15 15:54:41 user nova-compute[75095]:     <apic/>
Nov 15 15:54:41 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:54:41 user nova-compute[75095]:   </features>
Nov 15 15:54:41 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:54:41 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:54:41 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:54:41 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:54:41 user nova-compute[75095]:   </clock>
Nov 15 15:54:41 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:54:41 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:54:41 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:54:41 user nova-compute[75095]:   </cpu>
Nov 15 15:54:41 user nova-compute[75095]:   <devices>
Nov 15 15:54:41 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:54:41 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:54:41 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk"/>
Nov 15 15:54:41 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:54:41 user nova-compute[75095]:     </disk>
Nov 15 15:54:41 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:54:41 user nova-compute[75095]:       <mac address="fa:16:3e:43:42:f4"/>
Nov 15 15:54:41 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:54:41 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:54:41 user nova-compute[75095]:       <target dev="tap2dd1d029-e7"/>
Nov 15 15:54:41 user nova-compute[75095]:     </interface>
Nov 15 15:54:41 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:54:41 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/console.log" append="off"/>
Nov 15 15:54:41 user nova-compute[75095]:     </serial>
Nov 15 15:54:41 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:54:41 user nova-compute[75095]:     <video>
Nov 15 15:54:41 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:54:41 user nova-compute[75095]:     </video>
Nov 15 15:54:41 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:54:41 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:54:41 user nova-compute[75095]:     </rng>
Nov 15 15:54:41 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:54:41 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:54:41 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:54:41 user nova-compute[75095]:     </memballoon>
Nov 15 15:54:41 user nova-compute[75095]:   </devices>
Nov 15 15:54:41 user nova-compute[75095]: </domain>
Nov 15 15:54:41 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1459784465',display_name='tempest-VolumesAdminNegativeTest-server-1459784465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1459784465',id=34,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-0ihf2b04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:54:40Z,user_data=None,user_id='07d584f2b0224d5aa6569a95556e0365',uuid=f741ca0b-a41d-4b5b-91df-7e2606e28299,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG os_vif [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0b713ab-baa5-51a1-8ae8-26d02c839d61', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2dd1d029-e7, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2dd1d029-e7, col_values=(('qos', UUID('a6cab321-2a6f-4069-9bdf-5ed7de3ac237')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2dd1d029-e7, col_values=(('external_ids', {'iface-id': '2dd1d029-e720-4479-ab6a-577ec387d424', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:42:f4', 'vm-uuid': 'f741ca0b-a41d-4b5b-91df-7e2606e28299'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:41 user nova-compute[75095]: INFO os_vif [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7')
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] No VIF found with MAC fa:16:3e:43:42:f4, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Updated VIF entry in instance network info cache for port 2dd1d029-e720-4479-ab6a-577ec387d424. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Updating instance_info_cache with network_info: [{"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-44b41c10-66a9-4b41-9649-6eb36c24f0d8 req-b66cc498-c144-40e3-93bd-f34c7f9f19d3 service nova] Releasing lock "refresh_cache-f741ca0b-a41d-4b5b-91df-7e2606e28299" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:54:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 is timed out.
Nov 15 15:54:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config.
Nov 15 15:54:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EgquTsSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[068a7af4-4a08-4e7f-9d91-1a0391945983]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:54:42 user nova-compute[75095]: No targets found.
Nov 15 15:54:42 user nova-compute[75095]: iSNS:
Nov 15 15:54:42 user nova-compute[75095]: No targets found.
Nov 15 15:54:42 user nova-compute[75095]: STATIC:
Nov 15 15:54:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:54:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:54:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c
Nov 15 15:54:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:54:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:42 user nova-compute[75095]: FIRMWARE:
Nov 15 15:54:42 user nova-compute[75095]: No targets found.
Nov 15 15:54:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:54:42 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:54:42 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8dd38-983d-409d-8c73-73a93e38e2ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d2d4ec-c80f-4812-89a8-638660ab460d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)
Nov 15 15:54:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:42 user nova-compute[75095]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c (non-flash)
Nov 15 15:54:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c623b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd999f9c-a613-45cb-bb7a-220ea951be84]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78593d71-410f-4973-8fa3-6eebbe751406]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[141a2a35-1fff-44b0-919b-16aace19bab9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e16a7-65e5-4d15-93a9-bf0e27af935f]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9fcdca-8701-4dbc-b3cc-525cf1744e5f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef9c85-574e-4c7f-9bff-a07a92e67b88]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260]
Nov 15 15:54:42 user nova-compute[75095]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c, portal: 172.16.0.220,3260] successful.
Nov 15 15:54:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01328b6f-ad8c-4508-b1e6-6bcc91d7199c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ef3dd2-0e01-495a-8e2d-7bd68e1c2a38]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== disconnect_volume: return (292ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG nova.compute.manager [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG nova.compute.manager [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] No waiting events found dispatching network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:43 user nova-compute[75095]: WARNING nova.compute.manager [req-157aef52-ddff-4250-b43c-2723f9c1526d req-700ebc99-c222-4a11-9a10-3cfa5abb51dd service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received unexpected event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 for instance with vm_state building and task_state spawning.
Nov 15 15:54:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24a05f8-dd34-44a7-bb92-ee1bdd1157e7 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:54:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Instance spawned successfully.
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] No waiting events found dispatching network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:45 user nova-compute[75095]: WARNING nova.compute.manager [req-2b898abb-8644-4bd8-9538-fae28b15af5f req-31b5ba39-2946-4d1e-8396-dedbc8dc2555 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received unexpected event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 for instance with vm_state building and task_state spawning.
Nov 15 15:54:45 user nova-compute[75095]: INFO nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 15 15:54:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:54:45 user nova-compute[75095]: INFO nova.compute.manager [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Took 5.84 seconds to build instance.
Nov 15 15:54:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f03986f7-630c-4dce-bb24-72b0e565ad61 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.933s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:46 user nova-compute[75095]: INFO nova.compute.manager [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Terminating instance
Nov 15 15:54:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Instance destroyed successfully.
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid 6445dc31-6825-4762-9d09-b95ea70e5df3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1986202156',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1986202156',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV1bg4snzT91JaZJZh4Pqt8LkW+DGx6y0ocQB2kDue2rjTXnLl/rfUoJOkcIGUYcbIFKcAEnynaHJmHu4b0OdnSwJXPN2bnu/qF6gVv4wM0ZU8mzaKmt9sy5y+1Evc8UQ==',key_name='tempest-keypair-417741693',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:50:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-my9ww1gx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:50:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=6445dc31-6825-4762-9d09-b95ea70e5df3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "e180701e-156f-4c51-8282-1806863e595c", "address": "fa:16:3e:ce:cd:81", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape180701e-15", "ovs_interfaceid": "e180701e-156f-4c51-8282-1806863e595c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_vif [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape180701e-15, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d0f8ef8d-ba57-4b6f-b935-79fe7106459a) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:47 user nova-compute[75095]: INFO os_vif [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:cd:81,bridge_name='br-int',has_traffic_filtering=True,id=e180701e-156f-4c51-8282-1806863e595c,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape180701e-15')
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-unplugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] No waiting events found dispatching network-vif-unplugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-unplugged-e180701e-156f-4c51-8282-1806863e595c for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Acquiring lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] No waiting events found dispatching network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:54:47 user nova-compute[75095]: WARNING nova.compute.manager [req-3ac1ac50-1c49-4313-bb91-caa369e464a6 req-73f6994f-b397-4a34-99c3-ca4b8a3ff520 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received unexpected event network-vif-plugged-e180701e-156f-4c51-8282-1806863e595c for instance with vm_state active and task_state deleting.
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JzsXDbgF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:47 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45367f5f-37a2-4a38-b417-6bcff1f2e2b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:54:47 user nova-compute[75095]: No targets found.
Nov 15 15:54:47 user nova-compute[75095]: iSNS:
Nov 15 15:54:47 user nova-compute[75095]: No targets found.
Nov 15 15:54:47 user nova-compute[75095]: STATIC:
Nov 15 15:54:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa
Nov 15 15:54:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:54:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:54:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:54:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:54:47 user nova-compute[75095]: FIRMWARE:
Nov 15 15:54:47 user nova-compute[75095]: No targets found.
Nov 15 15:54:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:54:47 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:54:47 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[185f3e66-fc30-4e70-a1e0-06d6bd954274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a13143-8692-4b01-af30-3f5b1c2de2c0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:47 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:47 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:54:47 user nova-compute[75095]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa (non-flash)
Nov 15 15:54:47 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:54:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1fd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b64f4e-ff88-40be-8c10-d387b267c41e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ce9b8-2dc8-4d82-853d-b8f6e370e2d9]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b075efe8-605d-499a-8d97-a912cbce9b16]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[810d3e17-8231-4487-888b-beb66ff3e568]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd0b361-1669-448d-beee-f9d6c9ee9a0d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[397935e9-38ca-46a4-8c08-acd2c9f5ad03]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260]
Nov 15 15:54:47 user nova-compute[75095]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa, portal: 172.16.0.220,3260] successful.
Nov 15 15:54:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0a21996-2d45-41c9-bf1c-9abc620458aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[edccb383-d110-409e-8245-75a9fd6582c2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (334ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:54:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Deleting instance files /opt/stack/data/nova/instances/6445dc31-6825-4762-9d09-b95ea70e5df3_del
Nov 15 15:54:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Deletion of /opt/stack/data/nova/instances/6445dc31-6825-4762-9d09-b95ea70e5df3_del complete
Nov 15 15:54:47 user nova-compute[75095]: INFO nova.compute.manager [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 15 15:54:47 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:54:47 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:54:48 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:48 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Took 0.67 seconds to deallocate network for instance.
Nov 15 15:54:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-869cce54-deb0-4f40-be6f-42132fd5151a req-74a0dbae-a0e7-4d4a-bec8-7582213832b4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Received event network-vif-deleted-e180701e-156f-4c51-8282-1806863e595c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:48 user nova-compute[75095]: INFO nova.compute.manager [req-869cce54-deb0-4f40-be6f-42132fd5151a req-74a0dbae-a0e7-4d4a-bec8-7582213832b4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Neutron deleted interface e180701e-156f-4c51-8282-1806863e595c; detaching it from the instance and deleting it from the info cache
Nov 15 15:54:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-869cce54-deb0-4f40-be6f-42132fd5151a req-74a0dbae-a0e7-4d4a-bec8-7582213832b4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-869cce54-deb0-4f40-be6f-42132fd5151a req-74a0dbae-a0e7-4d4a-bec8-7582213832b4 service nova] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Detach interface failed, port_id=e180701e-156f-4c51-8282-1806863e595c, reason: Instance 6445dc31-6825-4762-9d09-b95ea70e5df3 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 15:54:49 user nova-compute[75095]: INFO nova.compute.manager [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Took 0.80 seconds to detach 1 volumes for instance.
Nov 15 15:54:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 6445dc31-6825-4762-9d09-b95ea70e5df3] Deleting volume: c0a21996-2d45-41c9-bf1c-9abc620458aa {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 15:54:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:49 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:54:49 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:54:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.540s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:49 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance 6445dc31-6825-4762-9d09-b95ea70e5df3
Nov 15 15:54:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-51a194ac-0013-4f98-a524-4835a878d161 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "6445dc31-6825-4762-9d09-b95ea70e5df3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.508s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-changed-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Refreshing instance network info cache due to event network-changed-2790c9fb-a2e5-4d84-8839-d9521407ee7f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] Acquiring lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] Acquired lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG nova.network.neutron [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Refreshing network info cache for port 2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:54:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Ignoring supplied device name: /dev/vdb
Nov 15 15:54:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:54:57 user nova-compute[75095]: INFO nova.compute.manager [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Attaching volume c291ad19-830d-4417-8721-4db869518f5f to /dev/vdb
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.utils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updated VIF entry in instance network info cache for port 2790c9fb-a2e5-4d84-8839-d9521407ee7f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updating instance_info_cache with network_info: [{"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90d510a-3318-453a-b6ff-5b4e753d099c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-88094d6c-b4ba-4d91-90b3-809239c848f6 req-fa5aa8e4-121a-41be-b654-de454db338a6 service nova] Releasing lock "refresh_cache-33eedd67-b9a6-492f-a536-06850ed0752c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b3af8-3ba8-4757-b089-d8f07cdfdee2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae5b0c-0b6a-459d-9231-58b3604b65f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0a26c-57d0-4c60-b501-966f9b334f9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:54:57 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:54:57 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a721d-0a37-4d0a-a860-02c29891b7a1]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG os_brick.utils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:54:57 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updating existing volume attachment record: a850cb0c-3f9d-4b10-91af-ed396cc59b16 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:54:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkBJSApf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:01 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447ae52-665b-4519-921e-e313d671672c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:55:01 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd16e17-277b-4d8a-b5da-b55fa8dd69a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f] added
Nov 15 15:55:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b34af-7e57-4f9c-99f1-700b14dfbd11]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aaec7c-e2a0-425c-b0ae-5954c5f23400]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkBJSApf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkBJSApf" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be5b65-d80a-4e8f-9229-a91faed1645a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkBJSApf'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d902d-f63a-4713-8974-b223a995fb45]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[468eaa55-11c3-4d8a-ad00-694b67d98db0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617631b-131d-484d-a039-28375eabeb10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260]
Nov 15 15:55:02 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[762c1b91-5b40-4259-82f6-1416e2a700a1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f1c43-ff34-44e6-8b88-69f85f0dcf40]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:02 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d24a9-415b-4b65-a124-f1f7f2a6ddd9]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:55:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkBJSApf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26431393439366134', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431393439366134', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:55:03 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:03 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:55:03 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:03 user nova-compute[75095]:   <serial>c291ad19-830d-4417-8721-4db869518f5f</serial>
Nov 15 15:55:03 user nova-compute[75095]: </disk>
Nov 15 15:55:03 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] No VIF found with MAC fa:16:3e:bd:b0:92, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:55:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9fcab33c-f740-4090-a139-69a6dbda5c6f tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.824s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:14 user nova-compute[75095]: INFO nova.compute.manager [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attaching volume 318a7ba9-2aa9-42ce-b67a-68c6026df4a3 to /dev/vdb
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.utils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[994a6112-b6e8-412d-ad8d-ec37e38e88cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a55e56-0400-475b-889b-d3b9c472a8c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53f803-590b-44ae-a6a4-cb8186a8e9ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[103d9375-9d8a-4504-b852-adc7c78a5c6d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:14 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:55:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef61252d-5b76-46d3-8277-3217a5e280a8]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG os_brick.utils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:14 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating existing volume attachment record: 68c78764-f2ec-4dd9-abe6-34d63e7703e2 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:15 user nova-compute[75095]: INFO nova.compute.manager [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Detaching volume c291ad19-830d-4417-8721-4db869518f5f
Nov 15 15:55:15 user nova-compute[75095]: INFO nova.virt.block_device [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Attempting to driver detach volume c291ad19-830d-4417-8721-4db869518f5f from mountpoint /dev/vdb
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Attempting to detach device vdb from instance 33eedd67-b9a6-492f-a536-06850ed0752c from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:55:16 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:16 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:55:16 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:16 user nova-compute[75095]:   <serial>c291ad19-830d-4417-8721-4db869518f5f</serial>
Nov 15 15:55:16 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:55:16 user nova-compute[75095]: </disk>
Nov 15 15:55:16 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:55:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully detached device vdb from instance 33eedd67-b9a6-492f-a536-06850ed0752c from the persistent domain config.
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 33eedd67-b9a6-492f-a536-06850ed0752c from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:55:16 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:16 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 15:55:16 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:16 user nova-compute[75095]:   <serial>c291ad19-830d-4417-8721-4db869518f5f</serial>
Nov 15 15:55:16 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:55:16 user nova-compute[75095]: </disk>
Nov 15 15:55:16 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updating instance_info_cache with network_info: [{"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-71532b12-b122-4de2-b051-a933db8e7c41" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:55:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:17 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egWqtFrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:19 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e3e5ad-08b6-4d63-8518-92cc44cb502a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:55:19 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[787ea82a-abcb-4f58-b97d-201f7b63e5a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3] added
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[442e8279-e8af-4c01-bd7e-4a1ac6ecfa54]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f866123e-621c-4b5c-90ad-90d725fffe3f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egWqtFrE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egWqtFrE" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef9d7d-302f-4081-b8c4-987f704e44e2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egWqtFrE'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2248e27-1ede-45d3-a384-1272d06e9c7d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef299757-7e8a-4c4c-a880-77de43b37ad4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e89c14-f756-4a7c-8ac6-71d82e329c59]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260]
Nov 15 15:55:19 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540e4b6-6a10-4043-a878-a75b35cd6d70]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c28dd-eb48-4908-9fb8-b5e93c607c65]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:19 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[daddc21e-459c-414c-a8f3-5646a805534c]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:55:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egWqtFrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26532616530633263', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532616530633263', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:55:20 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:20 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:55:20 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:20 user nova-compute[75095]:   <serial>318a7ba9-2aa9-42ce-b67a-68c6026df4a3</serial>
Nov 15 15:55:20 user nova-compute[75095]: </disk>
Nov 15 15:55:20 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No VIF found with MAC fa:16:3e:5e:69:d0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:55:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-68dd79e5-f21e-440a-8482-0c9bfca0deff tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.768s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:21 user nova-compute[75095]: INFO nova.compute.manager [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Rescuing
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:22 user nova-compute[75095]: WARNING nova.compute.manager [req-97c24dc1-79de-46d3-bfb6-48590365a86f req-89aa6a13-e4c7-476e-b49c-14a9c90d2a2c service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state active and task_state rescuing.
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance destroyed successfully.
Nov 15 15:55:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Attempting rescue
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:55:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Creating image(s)
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'trusted_certs' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue" returned: 0 in 0.082s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'migration_context' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.base [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<aad21504-a43c-4451-8b5b-90ac2a8fc3a5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start _get_guest_xml network_info=[{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:64:3a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.base [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<aad21504-a43c-4451-8b5b-90ac2a8fc3a5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'numa_topology' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.base [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<aad21504-a43c-4451-8b5b-90ac2a8fc3a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:55:22 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:22 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:55:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'vcpu_model' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.objects.base [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<aad21504-a43c-4451-8b5b-90ac2a8fc3a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1894338793',display_name='tempest-ServerRescueNegativeTestJSON-server-1894338793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1894338793',id=26,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-wzgee21s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:50:45Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=aad21504-a43c-4451-8b5b-90ac2a8fc3a5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:64:3a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:64:3a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.objects.base [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<aad21504-a43c-4451-8b5b-90ac2a8fc3a5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:55:23 user nova-compute[75095]:   <uuid>aad21504-a43c-4451-8b5b-90ac2a8fc3a5</uuid>
Nov 15 15:55:23 user nova-compute[75095]:   <name>instance-0000001a</name>
Nov 15 15:55:23 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:55:23 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:55:23 user nova-compute[75095]:   <metadata>
Nov 15 15:55:23 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:55:23 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1894338793</nova:name>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:55:22</nova:creationTime>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:55:23 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:55:23 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:owner>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 15:55:23 user nova-compute[75095]:       </nova:owner>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:55:23 user nova-compute[75095]:       <nova:ports>
Nov 15 15:55:23 user nova-compute[75095]:         <nova:port uuid="24e5dc9c-6245-497d-8a25-1b5f0f24fbb2">
Nov 15 15:55:23 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:55:23 user nova-compute[75095]:         </nova:port>
Nov 15 15:55:23 user nova-compute[75095]:       </nova:ports>
Nov 15 15:55:23 user nova-compute[75095]:     </nova:instance>
Nov 15 15:55:23 user nova-compute[75095]:   </metadata>
Nov 15 15:55:23 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:55:23 user nova-compute[75095]:     <system>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="serial">aad21504-a43c-4451-8b5b-90ac2a8fc3a5</entry>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="uuid">aad21504-a43c-4451-8b5b-90ac2a8fc3a5</entry>
Nov 15 15:55:23 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:55:23 user nova-compute[75095]:     </system>
Nov 15 15:55:23 user nova-compute[75095]:   </sysinfo>
Nov 15 15:55:23 user nova-compute[75095]:   <os>
Nov 15 15:55:23 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:55:23 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:55:23 user nova-compute[75095]:   </os>
Nov 15 15:55:23 user nova-compute[75095]:   <features>
Nov 15 15:55:23 user nova-compute[75095]:     <acpi/>
Nov 15 15:55:23 user nova-compute[75095]:     <apic/>
Nov 15 15:55:23 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:55:23 user nova-compute[75095]:   </features>
Nov 15 15:55:23 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:55:23 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:55:23 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:55:23 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:55:23 user nova-compute[75095]:   </clock>
Nov 15 15:55:23 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:55:23 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:55:23 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:55:23 user nova-compute[75095]:   </cpu>
Nov 15 15:55:23 user nova-compute[75095]:   <devices>
Nov 15 15:55:23 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:55:23 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:55:23 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue"/>
Nov 15 15:55:23 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:     </disk>
Nov 15 15:55:23 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:55:23 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:55:23 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk"/>
Nov 15 15:55:23 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:     </disk>
Nov 15 15:55:23 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:55:23 user nova-compute[75095]:       <mac address="fa:16:3e:64:3a:ce"/>
Nov 15 15:55:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:55:23 user nova-compute[75095]:       <target dev="tap24e5dc9c-62"/>
Nov 15 15:55:23 user nova-compute[75095]:     </interface>
Nov 15 15:55:23 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:55:23 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/console.log" append="off"/>
Nov 15 15:55:23 user nova-compute[75095]:     </serial>
Nov 15 15:55:23 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:55:23 user nova-compute[75095]:     <video>
Nov 15 15:55:23 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:     </video>
Nov 15 15:55:23 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:55:23 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:55:23 user nova-compute[75095]:     </rng>
Nov 15 15:55:23 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:55:23 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:55:23 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:55:23 user nova-compute[75095]:     </memballoon>
Nov 15 15:55:23 user nova-compute[75095]:   </devices>
Nov 15 15:55:23 user nova-compute[75095]: </domain>
Nov 15 15:55:23 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance destroyed successfully.
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:64:3a:ce, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:23 user nova-compute[75095]: INFO nova.compute.manager [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Detaching volume 318a7ba9-2aa9-42ce-b67a-68c6026df4a3
Nov 15 15:55:23 user nova-compute[75095]: INFO nova.virt.block_device [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attempting to driver detach volume 318a7ba9-2aa9-42ce-b67a-68c6026df4a3 from mountpoint /dev/vdb
Nov 15 15:55:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Attempting to detach device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:55:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:23 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:55:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:   <serial>318a7ba9-2aa9-42ce-b67a-68c6026df4a3</serial>
Nov 15 15:55:23 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:55:23 user nova-compute[75095]: </disk>
Nov 15 15:55:23 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:55:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config.
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:55:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:23 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 15:55:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:55:23 user nova-compute[75095]:   <serial>318a7ba9-2aa9-42ce-b67a-68c6026df4a3</serial>
Nov 15 15:55:23 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:55:23 user nova-compute[75095]: </disk>
Nov 15 15:55:23 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:55:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:24 user nova-compute[75095]: WARNING nova.compute.manager [req-fe995b14-0b6a-4b04-8f9c-f929d2e19325 req-df9c14d2-aab7-433f-9557-1f7dfd8710cf service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state active and task_state rescuing.
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:26 user nova-compute[75095]: WARNING nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state active and task_state rescuing.
Nov 15 15:55:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:26 user nova-compute[75095]: WARNING nova.compute.manager [req-350e06d1-dcde-481b-981b-1b177e5e8a2d req-1276a549-c7f8-4445-8b96-5114f57fdfce service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state active and task_state rescuing.
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3a11ebbe-f0eb-48b4-ba06-ca7a8e218b9c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:55:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7360MB free_disk=24.364776611328125GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 71532b12-b122-4de2-b051-a933db8e7c41 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 33eedd67-b9a6-492f-a536-06850ed0752c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f741ca0b-a41d-4b5b-91df-7e2606e28299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:55:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:55:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:55:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:36 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 33eedd67-b9a6-492f-a536-06850ed0752c is timed out.
Nov 15 15:55:36 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully detached device vdb from instance 33eedd67-b9a6-492f-a536-06850ed0752c from the live domain config.
Nov 15 15:55:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkBJSApf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:36 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249a5eb-64b7-4d85-907a-b786dedbebc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:55:36 user nova-compute[75095]: No targets found.
Nov 15 15:55:36 user nova-compute[75095]: iSNS:
Nov 15 15:55:36 user nova-compute[75095]: No targets found.
Nov 15 15:55:36 user nova-compute[75095]: STATIC:
Nov 15 15:55:36 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f
Nov 15 15:55:36 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:36 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:36 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:55:36 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:36 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:36 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:55:36 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:36 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:36 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3
Nov 15 15:55:36 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:36 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:36 user nova-compute[75095]: FIRMWARE:
Nov 15 15:55:36 user nova-compute[75095]: No targets found.
Nov 15 15:55:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:55:36 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:55:36 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45ac5be-0eea-4159-84df-a5189ff4cb75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de8e3fe-2a9c-4d7f-8466-d6099e58fad6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f (non-flash)
Nov 15 15:55:36 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3dc8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a2247-006c-4423-a2f9-436aff157100]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9eafa0-667e-4860-8df2-81d13d28bdc5]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb93f07-dc42-488c-b2aa-3f4fbe9d9265]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a5a4f-285e-44d9-b0b4-bf57b7906c33]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ba76f-fc3f-4e4e-b5f7-a95b80a156cd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec9026a-f69f-44dc-b30d-1d160c4bfb48]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260]
Nov 15 15:55:36 user nova-compute[75095]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fd9e36-f8f3-4047-a493-2c7f4e436655]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== disconnect_volume: return (335ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'flavor' on Instance uuid 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-463a6fd7-8008-42fe-8810-599f4366d1c8 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.922s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.753s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:37 user nova-compute[75095]: INFO nova.compute.manager [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Terminating instance
Nov 15 15:55:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-unplugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] No waiting events found dispatching network-vif-unplugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e5bf2cd-c55a-46f0-a8bc-8456ac964800 req-3800f8f4-17eb-4611-bc41-613779bce5c0 service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-unplugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing instance network info cache due to event network-changed-7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Refreshing network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:55:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Instance destroyed successfully.
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lazy-loading 'resources' on Instance uuid 33eedd67-b9a6-492f-a536-06850ed0752c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1620545443',display_name='tempest-VolumesSnapshotTestJSON-instance-1620545443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1620545443',id=31,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNuSeRZEOjvOrTOYT0D+WCFVSwieQTOraPG/50kvBQADrcn/w4Pusdo+7pSOcXQXmzFYGAWyPrgaPOMlEPSs/uIhlMoR+JqiT6FMCs3NRl9/0/GklJxgcjY4QMk+BVkMzw==',key_name='tempest-keypair-1853719728',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='846a2bf6258b4e8eab8705b70442b9f8',ramdisk_id='',reservation_id='r-m4kz5qfs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1176209995',owner_user_name='tempest-VolumesSnapshotTestJSON-1176209995-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:53:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='122adc4dbe90486f8eed85dce6910d4f',uuid=33eedd67-b9a6-492f-a536-06850ed0752c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converting VIF {"id": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "address": "fa:16:3e:bd:b0:92", "network": {"id": "ac3b2df3-4699-474e-ad6c-0b2830488389", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-141296120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "846a2bf6258b4e8eab8705b70442b9f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2790c9fb-a2", "ovs_interfaceid": "2790c9fb-a2e5-4d84-8839-d9521407ee7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_vif [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2790c9fb-a2, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9689ea51-62cd-4a69-96d8-9ce5d4a82468) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:38 user nova-compute[75095]: INFO os_vif [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:b0:92,bridge_name='br-int',has_traffic_filtering=True,id=2790c9fb-a2e5-4d84-8839-d9521407ee7f,network=Network(ac3b2df3-4699-474e-ad6c-0b2830488389),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2790c9fb-a2')
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkBJSApf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:38 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f302085c-1c7c-4a1b-9f09-842f06d058f3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:55:38 user nova-compute[75095]: No targets found.
Nov 15 15:55:38 user nova-compute[75095]: iSNS:
Nov 15 15:55:38 user nova-compute[75095]: No targets found.
Nov 15 15:55:38 user nova-compute[75095]: STATIC:
Nov 15 15:55:38 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:55:38 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:38 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:38 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:55:38 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:38 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:38 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3
Nov 15 15:55:38 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:38 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:38 user nova-compute[75095]: FIRMWARE:
Nov 15 15:55:38 user nova-compute[75095]: No targets found.
Nov 15 15:55:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:55:38 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:55:38 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c291ad19-830d-4417-8721-4db869518f5f', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a302d5-a1b8-4b91-ab45-20b540a4377d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6430bb92-fe71-4f05-9729-a071b18dac4f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c230940>, {}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Disconnecting from: [] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.082s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] <== disconnect_volume: return (84ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:55:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Deleting instance files /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c_del
Nov 15 15:55:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Deletion of /opt/stack/data/nova/instances/33eedd67-b9a6-492f-a536-06850ed0752c_del complete
Nov 15 15:55:38 user nova-compute[75095]: INFO nova.compute.manager [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated VIF entry in instance network info cache for port 7be16d0d-57a4-4ee4-922b-e4837f781f65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8fa6e334-c631-4382-ae2c-57f60151426a req-051e94fe-78bd-4bcb-b0b4-43609c43fbc2 service nova] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:39 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:39 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Took 0.92 seconds to deallocate network for instance.
Nov 15 15:55:39 user nova-compute[75095]: WARNING nova.volume.cinder [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Attachment a850cb0c-3f9d-4b10-91af-ed396cc59b16 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a850cb0c-3f9d-4b10-91af-ed396cc59b16. (HTTP 404) (Request-ID: req-8cd7fb6e-f783-4464-a3d3-bb8b5ac42010)
Nov 15 15:55:39 user nova-compute[75095]: INFO nova.compute.manager [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 15:55:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] Acquiring lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] Lock "33eedd67-b9a6-492f-a536-06850ed0752c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] No waiting events found dispatching network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:40 user nova-compute[75095]: WARNING nova.compute.manager [req-3aebac78-23aa-4b57-954a-9e4bcf729c4b req-86482bc3-cf58-4eac-9530-cec0785fc9ad service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received unexpected event network-vif-plugged-2790c9fb-a2e5-4d84-8839-d9521407ee7f for instance with vm_state deleted and task_state None.
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.525s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:40 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Deleted allocations for instance 33eedd67-b9a6-492f-a536-06850ed0752c
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-changed-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Refreshing instance network info cache due to event network-changed-da912a65-e75f-4457-8721-8e8cb7fc5065. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.network.neutron [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Refreshing network info cache for port da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Stashing vm_state: active {{(pid=75095) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-329c1228-70d1-4f6b-ad21-102689e94dc4 tempest-VolumesSnapshotTestJSON-1176209995 tempest-VolumesSnapshotTestJSON-1176209995-project-member] Lock "33eedd67-b9a6-492f-a536-06850ed0752c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.652s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:55:40 user nova-compute[75095]: INFO nova.compute.claims [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Claim successful on node user
Nov 15 15:55:40 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating resource usage from migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.network.neutron [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updated VIF entry in instance network info cache for port da912a65-e75f-4457-8721-8e8cb7fc5065. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.network.neutron [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-1da94864-583c-4bc8-90bb-59be61e2f321 req-3dcc8793-de3d-466f-b35e-2a17205e7fab service nova] [instance: 33eedd67-b9a6-492f-a536-06850ed0752c] Received event network-vif-deleted-2790c9fb-a2e5-4d84-8839-d9521407ee7f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:40 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.519s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:41 user nova-compute[75095]: INFO nova.compute.manager [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Migrating
Nov 15 15:55:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Starting migrate_disk_and_power_off {{(pid=75095) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:42 user nova-compute[75095]: WARNING nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state active and task_state resize_migrating.
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:42 user nova-compute[75095]: WARNING nova.compute.manager [req-17d72f8c-b6a2-497e-9510-409b1f6fb53d req-8215396e-1cb8-41c6-9996-dac45e4fd5bb service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state active and task_state resize_migrating.
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance destroyed successfully.
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda912a65-e7, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ff9acc7-e4bc-440c-a604-ddd55ea669c9) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:42 user nova-compute[75095]: INFO os_vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7')
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ef922d-636c-4346-ba17-68b824603dea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:55:42 user nova-compute[75095]: No targets found.
Nov 15 15:55:42 user nova-compute[75095]: iSNS:
Nov 15 15:55:42 user nova-compute[75095]: No targets found.
Nov 15 15:55:42 user nova-compute[75095]: STATIC:
Nov 15 15:55:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:55:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:55:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3
Nov 15 15:55:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:42 user nova-compute[75095]: FIRMWARE:
Nov 15 15:55:42 user nova-compute[75095]: No targets found.
Nov 15 15:55:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:55:42 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:55:42 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549bd2d-ed68-43e7-bc66-6e1a3ef6b773]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d259a18-a45d-4332-8615-ae62cf60593e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c623be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a7eae5-a5c3-46cb-af81-e354af5b50be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c756ac-f505-4f62-b20f-e5b409c9191e]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3f6298-cdf8-4ed6-a01e-5e9ad111aa6a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b5ed7-b887-465b-8009-ac62304c76e1]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9419aff-95c9-48ff-bfdc-76f4330957cd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7781be31-4fb5-4413-8582-29e6f0ce30d1]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]
Nov 15 15:55:42 user nova-compute[75095]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eed65c9-e92f-4a6d-bbad-6af21002868b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== disconnect_volume: return (305ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:55:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:55:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:43 user nova-compute[75095]: DEBUG nova.network.neutron [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Port da912a65-e75f-4457-8721-8e8cb7fc5065 binding to destination host user is already ACTIVE {{(pid=75095) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 15:55:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:55:44 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 is timed out.
Nov 15 15:55:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config.
Nov 15 15:55:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egWqtFrE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:44 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[044fd3db-d177-4db4-9e3d-6d4686f7e35f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:55:44 user nova-compute[75095]: No targets found.
Nov 15 15:55:44 user nova-compute[75095]: iSNS:
Nov 15 15:55:44 user nova-compute[75095]: No targets found.
Nov 15 15:55:44 user nova-compute[75095]: STATIC:
Nov 15 15:55:44 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:55:44 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:44 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:44 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3
Nov 15 15:55:44 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:55:44 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:55:44 user nova-compute[75095]: FIRMWARE:
Nov 15 15:55:44 user nova-compute[75095]: No targets found.
Nov 15 15:55:44 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:55:44 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:55:44 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec2098-4359-4816-82ff-27a1e1fdf060]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a00064-edb1-47a1-a402-75de87375daf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:44 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:44 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:44 user nova-compute[75095]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 (non-flash)
Nov 15 15:55:44 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1fc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fa9617-0366-4bfa-99d6-27655a5e0794]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[542b318b-4dbf-437f-8ff6-3a6b95906ead]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7177a6f5-5a0a-4253-bb27-f7ad66a1ff3f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65bd063-54e4-4208-85e9-bc797763fc5c]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e21aa8-f442-465a-83f6-bb9319df8d2d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9872b4e-e485-471e-abf1-4db9f5b1f699]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260]
Nov 15 15:55:44 user nova-compute[75095]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:44 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:318a7ba9-2aa9-42ce-b67a-68c6026df4a3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dd0c56-6766-4c34-8817-0259c0cc5f62]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== disconnect_volume: return (306ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.utils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[df190297-8f66-4eda-8d18-4f513c3d7984]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f42d366-a78f-44d5-8ec2-3a6921e964f8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36a11df-fa20-4fa2-a6ba-c9d4ef6c9ada]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a2203-c26a-49c5-b35d-2bcda32e294a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:44 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:55:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4064763-3037-43df-b286-540081da06be]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:55:44 user nova-compute[75095]: DEBUG os_brick.utils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f51d97b7-d13e-42ab-b76a-5dae36107432 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.661s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:55:45 user nova-compute[75095]: INFO nova.compute.claims [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Claim successful on node user
Nov 15 15:55:45 user nova-compute[75095]: INFO nova.compute.manager [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] instance snapshotting
Nov 15 15:55:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Beginning live snapshot process
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json -f qcow2 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:55:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG nova.policy [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:55:46 user nova-compute[75095]: INFO nova.virt.block_device [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Booting with volume 4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 at /dev/vda
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54.delta 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54.delta 1073741824" returned: 0 in 0.055s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 15:55:46 user nova-compute[75095]: DEBUG os_brick.utils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2020257-8141-45c6-81e3-87f865983084]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c025af99-4bc0-47cd-944e-cb82125ffcef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f751aff0-75e5-4a4d-9265-d96b097f3a84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b644070f-6f24-4e14-8199-d5e6b1f48ffc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:55:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:55:47 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:55:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b669b2b-c611-45d9-947c-eed5e0cd8296]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG os_brick.utils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating existing volume attachment record: 780858a3-8f87-412e-9cb9-834527828930 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Successfully created port: 58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:55:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75095) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 15:55:48 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54.delta /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Successfully updated port: 58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-changed-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Refreshing instance network info cache due to event network-changed-58e89d65-b423-49b3-b43d-a606f25cf3f1. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] Acquiring lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] Acquired lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Refreshing network info cache for port 58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6e2ec27-684b-4665-abdd-c49a4d43063c req-3bcd0f47-d0a8-4271-9dca-b17d9b36f48e service nova] Releasing lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54.delta /opt/stack/data/nova/instances/snapshots/tmph7ysko1y/4f9325601ed647cb8ca6556b1f2eaf54" returned: 0 in 0.458s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:48 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Snapshot extracted, beginning image upload
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating instance_info_cache with network_info: [{"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:55:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance network_info: |[{"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Starting finish_migration {{(pid=75095) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:55:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Creating image(s)
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start _get_guest_xml network_info=[{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '3fb60e7d-26af-436f-a64b-871f0c5516ed', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'c63a3174-966d-4ce8-95c3-53a8b817a2a3', 'attached_at': '2023-11-15T15:55:49.000000', 'detached_at': '', 'volume_id': '53c59e98-65e8-4447-bcb4-52253fecafe1', 'serial': '53c59e98-65e8-4447-bcb4-52253fecafe1'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:55:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:21Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:49 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c4ff1-6f95-4d7e-9e95-6266a50cdd53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:55:49 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69554cfa-5b43-417f-8e84-a0c980b45b37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1] added
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31a09a-ef0b-4931-831f-352042d0b76a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[34addfd4-c872-40fd-a1bf-8342e805a560]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeFNWxSX {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jeFNWxSX" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e42cabd-3170-4563-9149-f4c91f87f6b4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jeFNWxSX'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[162f6617-b339-4aa4-a181-27c336a01b1f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34e4eb-5380-4757-b452-0f2107b7473b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf3a268-4dea-4cef-af09-46ed5f41bc41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]
Nov 15 15:55:49 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[63678edf-0815-4ed2-9f02-e715c36ae0f4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b34d4-c8e8-496a-9ad1-2b9768a65b36]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1d2fc7-6df2-45c8-b3e4-ff28b3db4479]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:55:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:55:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23034613764363033', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034613764363033', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:55:51 user nova-compute[75095]:   <uuid>c63a3174-966d-4ce8-95c3-53a8b817a2a3</uuid>
Nov 15 15:55:51 user nova-compute[75095]:   <name>instance-00000020</name>
Nov 15 15:55:51 user nova-compute[75095]:   <memory>2097152</memory>
Nov 15 15:55:51 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:55:51 user nova-compute[75095]:   <metadata>
Nov 15 15:55:51 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:55:51 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:55:51 user nova-compute[75095]:       <nova:name>tempest-ServerActionsTestOtherA-server-831689889</nova:name>
Nov 15 15:55:51 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:55:49</nova:creationTime>
Nov 15 15:55:51 user nova-compute[75095]:       <nova:flavor name="m1.small">
Nov 15 15:55:51 user nova-compute[75095]:         <nova:memory>2048</nova:memory>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:disk>20</nova:disk>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:55:51 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:55:51 user nova-compute[75095]:       <nova:owner>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:user uuid="975ca4994eb74b6bbf541bb308b148f1">tempest-ServerActionsTestOtherA-440053215-project-member</nova:user>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:project uuid="18c587b1467441ceb091ece4e973408e">tempest-ServerActionsTestOtherA-440053215</nova:project>
Nov 15 15:55:51 user nova-compute[75095]:       </nova:owner>
Nov 15 15:55:51 user nova-compute[75095]:       <nova:ports>
Nov 15 15:55:51 user nova-compute[75095]:         <nova:port uuid="da912a65-e75f-4457-8721-8e8cb7fc5065">
Nov 15 15:55:51 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 15:55:51 user nova-compute[75095]:         </nova:port>
Nov 15 15:55:51 user nova-compute[75095]:       </nova:ports>
Nov 15 15:55:51 user nova-compute[75095]:     </nova:instance>
Nov 15 15:55:51 user nova-compute[75095]:   </metadata>
Nov 15 15:55:51 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:55:51 user nova-compute[75095]:     <system>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="serial">c63a3174-966d-4ce8-95c3-53a8b817a2a3</entry>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="uuid">c63a3174-966d-4ce8-95c3-53a8b817a2a3</entry>
Nov 15 15:55:51 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:55:51 user nova-compute[75095]:     </system>
Nov 15 15:55:51 user nova-compute[75095]:   </sysinfo>
Nov 15 15:55:51 user nova-compute[75095]:   <os>
Nov 15 15:55:51 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:55:51 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:55:51 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:55:51 user nova-compute[75095]:   </os>
Nov 15 15:55:51 user nova-compute[75095]:   <features>
Nov 15 15:55:51 user nova-compute[75095]:     <acpi/>
Nov 15 15:55:51 user nova-compute[75095]:     <apic/>
Nov 15 15:55:51 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:55:51 user nova-compute[75095]:   </features>
Nov 15 15:55:51 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:55:51 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:55:51 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:55:51 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:55:51 user nova-compute[75095]:   </clock>
Nov 15 15:55:51 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:55:51 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:55:51 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:55:51 user nova-compute[75095]:   </cpu>
Nov 15 15:55:51 user nova-compute[75095]:   <devices>
Nov 15 15:55:51 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:55:51 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:51 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 15:55:51 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:55:51 user nova-compute[75095]:       <serial>53c59e98-65e8-4447-bcb4-52253fecafe1</serial>
Nov 15 15:55:51 user nova-compute[75095]:     </disk>
Nov 15 15:55:51 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:55:51 user nova-compute[75095]:       <mac address="fa:16:3e:d1:11:75"/>
Nov 15 15:55:51 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:51 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:55:51 user nova-compute[75095]:       <target dev="tapda912a65-e7"/>
Nov 15 15:55:51 user nova-compute[75095]:     </interface>
Nov 15 15:55:51 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:55:51 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3/console.log" append="off"/>
Nov 15 15:55:51 user nova-compute[75095]:     </serial>
Nov 15 15:55:51 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:55:51 user nova-compute[75095]:     <video>
Nov 15 15:55:51 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:51 user nova-compute[75095]:     </video>
Nov 15 15:55:51 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:55:51 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:55:51 user nova-compute[75095]:     </rng>
Nov 15 15:55:51 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:55:51 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:55:51 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:55:51 user nova-compute[75095]:     </memballoon>
Nov 15 15:55:51 user nova-compute[75095]:   </devices>
Nov 15 15:55:51 user nova-compute[75095]: </domain>
Nov 15 15:55:51 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-825000405-network", "vif_mac": "fa:16:3e:d1:11:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86785b53-13f7-5077-bce3-b94652f18e5d', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Snapshot image upload complete
Nov 15 15:55:51 user nova-compute[75095]: INFO nova.compute.manager [None req-db237dee-5427-43c1-bde1-4773e5f40526 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Took 5.07 seconds to snapshot the instance on the hypervisor.
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda912a65-e7, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda912a65-e7, col_values=(('qos', UUID('6dce46fa-c65e-4541-ad68-d55a585c7a70')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda912a65-e7, col_values=(('external_ids', {'iface-id': 'da912a65-e75f-4457-8721-8e8cb7fc5065', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:11:75', 'vm-uuid': 'c63a3174-966d-4ce8-95c3-53a8b817a2a3'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:51 user nova-compute[75095]: INFO os_vif [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7')
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] No VIF found with MAC fa:16:3e:d1:11:75, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:55:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Creating image(s)
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Ensure instance console log exists: /opt/stack/data/nova/instances/9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Start _get_guest_xml network_info=[{"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '780858a3-8f87-412e-9cb9-834527828930', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7', 'attached_at': '', 'detached_at': '', 'volume_id': '4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'serial': '4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:55:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:55:51 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:51 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:55:51 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5170a43b-5a27-4fa0-a200-547eead87442]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:55:51 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6beeb87-1eea-4c45-a331-b9a1402a8892]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335] added
Nov 15 15:55:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ccae40-6a46-438b-a553-f5a229cd6c4e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751a564-48af-4fcc-b3a8-dd0a17de868f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxtRwJqj {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxtRwJqj" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76985c3d-03b7-4901-a40a-145c1140b7c2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxtRwJqj'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[81424df7-10f8-4e42-89d9-2e3d1b51c87d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b815e63-13b3-40cd-9af7-72b274fb84fc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e220e-af01-4380-9caa-c1e50ab507fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]
Nov 15 15:55:52 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.
Nov 15 15:55:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ad05f2-0b4a-4f93-a0f3-1ef9a8ea6a18]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb818349-a578-47de-9d39-04aca9b1fb94]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:55:52 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22e5a25-8ca1-48e2-91d2-80a8f379f057]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:52 user nova-compute[75095]: WARNING nova.compute.manager [req-d2c27cf7-a84f-4f50-a812-9b4ddbd5a205 req-4ada8178-165c-477a-8fc6-8a12ed02afb0 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state active and task_state resize_finish.
Nov 15 15:55:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23937356532343534', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937356532343534', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221347918',display_name='tempest-TestVolumeBootPattern-server-221347918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221347918',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-xluvdlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:55:47Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:55:53 user nova-compute[75095]:   <uuid>9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7</uuid>
Nov 15 15:55:53 user nova-compute[75095]:   <name>instance-00000023</name>
Nov 15 15:55:53 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:55:53 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:55:53 user nova-compute[75095]:   <metadata>
Nov 15 15:55:53 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:55:53 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:55:53 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-server-221347918</nova:name>
Nov 15 15:55:53 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:55:51</nova:creationTime>
Nov 15 15:55:53 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:55:53 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:55:53 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:55:53 user nova-compute[75095]:       <nova:owner>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 15:55:53 user nova-compute[75095]:       </nova:owner>
Nov 15 15:55:53 user nova-compute[75095]:       <nova:ports>
Nov 15 15:55:53 user nova-compute[75095]:         <nova:port uuid="58e89d65-b423-49b3-b43d-a606f25cf3f1">
Nov 15 15:55:53 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 15:55:53 user nova-compute[75095]:         </nova:port>
Nov 15 15:55:53 user nova-compute[75095]:       </nova:ports>
Nov 15 15:55:53 user nova-compute[75095]:     </nova:instance>
Nov 15 15:55:53 user nova-compute[75095]:   </metadata>
Nov 15 15:55:53 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:55:53 user nova-compute[75095]:     <system>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="serial">9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7</entry>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="uuid">9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7</entry>
Nov 15 15:55:53 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:55:53 user nova-compute[75095]:     </system>
Nov 15 15:55:53 user nova-compute[75095]:   </sysinfo>
Nov 15 15:55:53 user nova-compute[75095]:   <os>
Nov 15 15:55:53 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:55:53 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:55:53 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:55:53 user nova-compute[75095]:   </os>
Nov 15 15:55:53 user nova-compute[75095]:   <features>
Nov 15 15:55:53 user nova-compute[75095]:     <acpi/>
Nov 15 15:55:53 user nova-compute[75095]:     <apic/>
Nov 15 15:55:53 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:55:53 user nova-compute[75095]:   </features>
Nov 15 15:55:53 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:55:53 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:55:53 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:55:53 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:55:53 user nova-compute[75095]:   </clock>
Nov 15 15:55:53 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:55:53 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:55:53 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:55:53 user nova-compute[75095]:   </cpu>
Nov 15 15:55:53 user nova-compute[75095]:   <devices>
Nov 15 15:55:53 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:55:53 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:55:53 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:55:53 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:55:53 user nova-compute[75095]:       <serial>4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335</serial>
Nov 15 15:55:53 user nova-compute[75095]:     </disk>
Nov 15 15:55:53 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:55:53 user nova-compute[75095]:       <mac address="fa:16:3e:7f:67:72"/>
Nov 15 15:55:53 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:53 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:55:53 user nova-compute[75095]:       <target dev="tap58e89d65-b4"/>
Nov 15 15:55:53 user nova-compute[75095]:     </interface>
Nov 15 15:55:53 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:55:53 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7/console.log" append="off"/>
Nov 15 15:55:53 user nova-compute[75095]:     </serial>
Nov 15 15:55:53 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:55:53 user nova-compute[75095]:     <video>
Nov 15 15:55:53 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:55:53 user nova-compute[75095]:     </video>
Nov 15 15:55:53 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:55:53 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:55:53 user nova-compute[75095]:     </rng>
Nov 15 15:55:53 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:55:53 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:55:53 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:55:53 user nova-compute[75095]:     </memballoon>
Nov 15 15:55:53 user nova-compute[75095]:   </devices>
Nov 15 15:55:53 user nova-compute[75095]: </domain>
Nov 15 15:55:53 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221347918',display_name='tempest-TestVolumeBootPattern-server-221347918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221347918',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-xluvdlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:55:47Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG os_vif [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b55eefd-3b35-5deb-b628-a15bfc4f3da4', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58e89d65-b4, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58e89d65-b4, col_values=(('qos', UUID('172100ec-52b0-43ac-9025-1455b132f3f0')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58e89d65-b4, col_values=(('external_ids', {'iface-id': '58e89d65-b423-49b3-b43d-a606f25cf3f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:67:72', 'vm-uuid': '9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:53 user nova-compute[75095]: INFO os_vif [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4')
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:7f:67:72, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:55:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:54 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance running successfully.
Nov 15 15:55:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Failed to set time: agent not configured {{(pid=75095) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-433a33fe-5dd2-44ba-9213-23962f5ea3b1 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] finish_migration finished successfully. {{(pid=75095) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] No waiting events found dispatching network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:54 user nova-compute[75095]: WARNING nova.compute.manager [req-f1393bcd-8183-48bb-a023-07854337dc5b req-085ef8dc-184a-4d16-8f20-7a9db444aaca service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received unexpected event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 for instance with vm_state building and task_state spawning.
Nov 15 15:55:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:55 user nova-compute[75095]: WARNING nova.compute.manager [req-b0d93350-d997-4291-a463-f39f70d1ca98 req-c40e79d7-27d5-4a15-bbed-8c05b48bb328 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state resized and task_state None.
Nov 15 15:55:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:56 user nova-compute[75095]: INFO nova.compute.manager [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Terminating instance
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-5db176a2-879a-4866-9a8f-7a728ea6dae8 req-2dabc818-14cd-4b21-927f-df9ef735ff80 service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:55:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance spawned successfully.
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] No waiting events found dispatching network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:56 user nova-compute[75095]: WARNING nova.compute.manager [req-7a1b3b0b-0b38-4f29-9656-6e2b7a5ed408 req-71678f65-cb10-436a-829c-b067e985c61d service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received unexpected event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 for instance with vm_state building and task_state spawning.
Nov 15 15:55:56 user nova-compute[75095]: INFO nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 15 15:55:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.compute.manager [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Took 11.14 seconds to build instance.
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f9d392c1-7641-48d0-8bd1-5c11abf8d68e tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.263s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Instance destroyed successfully.
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lazy-loading 'resources' on Instance uuid 71532b12-b122-4de2-b051-a933db8e7c41 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:47:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1909907023',display_name='tempest-ServersNegativeTestJSON-server-1909907023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1909907023',id=19,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:47:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04921366d7b34598b95002d0582de4d6',ramdisk_id='',reservation_id='r-tyg420o0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-981531680',owner_user_name='tempest-ServersNegativeTestJSON-981531680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:24Z,user_data=None,user_id='6be20f91b01f48c7a4b4d271b9c05954',uuid=71532b12-b122-4de2-b051-a933db8e7c41,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converting VIF {"id": "28efde6b-2633-4767-9192-fb7532de25f3", "address": "fa:16:3e:00:86:3e", "network": {"id": "d1c49d2b-f00a-4e96-8c03-e95b0f50d3db", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1182304454-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04921366d7b34598b95002d0582de4d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28efde6b-26", "ovs_interfaceid": "28efde6b-2633-4767-9192-fb7532de25f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG os_vif [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28efde6b-26, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df56bcf0-e149-42cd-8229-93751c72eb1d) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:55:57 user nova-compute[75095]: INFO os_vif [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:86:3e,bridge_name='br-int',has_traffic_filtering=True,id=28efde6b-2633-4767-9192-fb7532de25f3,network=Network(d1c49d2b-f00a-4e96-8c03-e95b0f50d3db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28efde6b-26')
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Deleting instance files /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41_del
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Deletion of /opt/stack/data/nova/instances/71532b12-b122-4de2-b051-a933db8e7c41_del complete
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.compute.manager [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 15 15:55:57 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Took 0.50 seconds to deallocate network for instance.
Nov 15 15:55:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-37860be7-0902-456b-8f96-f6e66d4df06f req-317d9a16-e65b-4b75-a7b0-86e405472b8d service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-deleted-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Deleted allocations for instance 71532b12-b122-4de2-b051-a933db8e7c41
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1136d49-aa72-42d7-b0c2-72de38840401 tempest-ServersNegativeTestJSON-981531680 tempest-ServersNegativeTestJSON-981531680-project-member] Lock "71532b12-b122-4de2-b051-a933db8e7c41" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.908s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:58 user nova-compute[75095]: WARNING nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state deleted and task_state None.
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:58 user nova-compute[75095]: WARNING nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state deleted and task_state None.
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:58 user nova-compute[75095]: WARNING nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state deleted and task_state None.
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:58 user nova-compute[75095]: WARNING nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-unplugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state deleted and task_state None.
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Acquiring lock "71532b12-b122-4de2-b051-a933db8e7c41-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] Lock "71532b12-b122-4de2-b051-a933db8e7c41-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:55:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] No waiting events found dispatching network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:55:58 user nova-compute[75095]: WARNING nova.compute.manager [req-bb3448d9-84e5-4f82-9f16-1026e716f266 req-6fdc60c5-8c6e-48cf-b5c1-4b21c21b75bd service nova] [instance: 71532b12-b122-4de2-b051-a933db8e7c41] Received unexpected event network-vif-plugged-28efde6b-2633-4767-9192-fb7532de25f3 for instance with vm_state deleted and task_state None.
Nov 15 15:56:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:56:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:15 user nova-compute[75095]: INFO nova.compute.manager [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attaching volume 8106b958-4341-47df-98ea-e6c6bde73e66 to /dev/vdb
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.utils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de20c20-8038-40ba-880f-99adc684d283]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedffa85-c23b-4c0e-9ea4-716095e9b3a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60967ff6-e470-4b08-9ab8-11b433c2005f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f82a64-c528-4361-8318-8d6ac28f1382]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:56:15 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:56:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6ab5eb-6262-4edc-a6ad-d588bdfb65af]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG os_brick.utils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:56:15 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating existing volume attachment record: 7187956a-9e0d-4b03-8807-d31ea77b9e42 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:56:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:56:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:56:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:56:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:18 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gawJkBtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:56:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:56:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:56:20 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae614cdd-f49a-4e31-8cb5-a51b28382264]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:56:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc036ca-bd9b-4b90-8d0a-a1d032c89a8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66] added
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c036bcf-54e1-49db-b456-a7e9d7049ed2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70554d9e-a225-4df1-a803-1b6dafa5dc37]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gawJkBtR {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gawJkBtR" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ce21e-fade-47d3-ab3a-cd6f4353438b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gawJkBtR'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[639e6475-2746-404e-a2b8-f351cdeaf8b2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb75f881-6748-45eb-8843-e060fc0c1c4f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e94b0a-407f-4d87-91f8-7d014e2153d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260]
Nov 15 15:56:20 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260] successful.
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b083ec48-9ef6-4144-9afb-bd2763248c94]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e802e-6e89-4edf-9c2d-09309d096f16]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)
Nov 15 15:56:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d2945-2931-4584-b275-1131df0bbbed]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:56:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gawJkBtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:56:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:56:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23962356163306436', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:56:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962356163306436', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:56:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:56:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:56:21 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:56:21 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:56:21 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:56:21 user nova-compute[75095]:   <serial>8106b958-4341-47df-98ea-e6c6bde73e66</serial>
Nov 15 15:56:21 user nova-compute[75095]: </disk>
Nov 15 15:56:21 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No VIF found with MAC fa:16:3e:5e:69:d0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b3ffd6e-3ffc-49fd-917b-f10d1e7b3f1d tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.779s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:56:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:56:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:25 user nova-compute[75095]: INFO nova.compute.manager [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Detaching volume 8106b958-4341-47df-98ea-e6c6bde73e66
Nov 15 15:56:25 user nova-compute[75095]: INFO nova.virt.block_device [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attempting to driver detach volume 8106b958-4341-47df-98ea-e6c6bde73e66 from mountpoint /dev/vdb
Nov 15 15:56:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Attempting to detach device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:56:25 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:56:25 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:56:25 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:56:25 user nova-compute[75095]:   <serial>8106b958-4341-47df-98ea-e6c6bde73e66</serial>
Nov 15 15:56:25 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:56:25 user nova-compute[75095]: </disk>
Nov 15 15:56:25 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:56:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config.
Nov 15 15:56:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:56:25 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:56:25 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:56:25 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:56:25 user nova-compute[75095]:   <serial>8106b958-4341-47df-98ea-e6c6bde73e66</serial>
Nov 15 15:56:25 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:56:25 user nova-compute[75095]: </disk>
Nov 15 15:56:25 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:56:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7414MB free_disk=24.35765838623047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Applying migration context for instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 as it has an incoming, in-progress migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7. Migration status is finished {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 15:56:27 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating resource usage from migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f741ca0b-a41d-4b5b-91df-7e2606e28299 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:56:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:56:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:56:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:34 user nova-compute[75095]: INFO nova.compute.manager [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Terminating instance
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-unplugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] No waiting events found dispatching network-vif-unplugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-e5ee39a6-109f-4144-b9e7-bfff0bd2f857 req-6f75a9ea-efea-4525-95e3-ea36f4cd6fbb service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-unplugged-2dd1d029-e720-4479-ab6a-577ec387d424 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Instance destroyed successfully.
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'resources' on Instance uuid f741ca0b-a41d-4b5b-91df-7e2606e28299 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:54:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1459784465',display_name='tempest-VolumesAdminNegativeTest-server-1459784465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1459784465',id=34,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:54:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-0ihf2b04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:54:45Z,user_data=None,user_id='07d584f2b0224d5aa6569a95556e0365',uuid=f741ca0b-a41d-4b5b-91df-7e2606e28299,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "2dd1d029-e720-4479-ab6a-577ec387d424", "address": "fa:16:3e:43:42:f4", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2dd1d029-e7", "ovs_interfaceid": "2dd1d029-e720-4479-ab6a-577ec387d424", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG os_vif [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2dd1d029-e7, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6cab321-2a6f-4069-9bdf-5ed7de3ac237) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:34 user nova-compute[75095]: INFO os_vif [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:42:f4,bridge_name='br-int',has_traffic_filtering=True,id=2dd1d029-e720-4479-ab6a-577ec387d424,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2dd1d029-e7')
Nov 15 15:56:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Deleting instance files /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299_del
Nov 15 15:56:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Deletion of /opt/stack/data/nova/instances/f741ca0b-a41d-4b5b-91df-7e2606e28299_del complete
Nov 15 15:56:34 user nova-compute[75095]: INFO nova.compute.manager [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 15:56:34 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:56:34 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:56:35 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Took 0.38 seconds to deallocate network for instance.
Nov 15 15:56:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-bc7409a0-6e6c-48b8-8b19-36ea3a0e472b req-d3398185-4e06-40d3-8814-b96a63537f4e service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-deleted-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:56:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:35 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Deleted allocations for instance f741ca0b-a41d-4b5b-91df-7e2606e28299
Nov 15 15:56:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7169fc6f-85ca-4834-96ac-878d0922169d tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.655s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:56:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] Acquiring lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:56:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:56:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] Lock "f741ca0b-a41d-4b5b-91df-7e2606e28299-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] No waiting events found dispatching network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:56:36 user nova-compute[75095]: WARNING nova.compute.manager [req-1c7868fb-b64b-4146-9fd6-df8aa14da7bd req-8c26797d-0692-4438-b443-fe25521dc9e0 service nova] [instance: f741ca0b-a41d-4b5b-91df-7e2606e28299] Received unexpected event network-vif-plugged-2dd1d029-e720-4479-ab6a-577ec387d424 for instance with vm_state deleted and task_state None.
Nov 15 15:56:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:56:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 is timed out.
Nov 15 15:56:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config.
Nov 15 15:56:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gawJkBtR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:56:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[967982d3-53ce-4950-ad3b-56099b6ce859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:56:45 user nova-compute[75095]: No targets found.
Nov 15 15:56:45 user nova-compute[75095]: iSNS:
Nov 15 15:56:45 user nova-compute[75095]: No targets found.
Nov 15 15:56:45 user nova-compute[75095]: STATIC:
Nov 15 15:56:45 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:56:45 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:56:45 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:56:45 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:56:45 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:56:45 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:56:45 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66
Nov 15 15:56:45 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:56:45 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:56:45 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 15:56:45 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:56:45 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:56:45 user nova-compute[75095]: FIRMWARE:
Nov 15 15:56:45 user nova-compute[75095]: No targets found.
Nov 15 15:56:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:56:45 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:56:45 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da2421b-4cce-418a-b790-2501a1b24f2b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ef57c4-50ab-4e7f-9eac-3e1456aaa01d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 (non-flash)
Nov 15 15:56:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c233010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0230466a-08ca-4f58-a2e2-65136a2f2074]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa6b326-32a6-4178-b75f-c54f326cb877]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[865c8f15-3fc7-49ad-bbeb-846494557a01]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb4fc94-9045-442c-8515-543dbfa1514e]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d720b123-a37a-4d5d-afe2-1f6380ce3804]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c690d57-7fbe-4d24-aa96-27e622b6c031]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260]
Nov 15 15:56:45 user nova-compute[75095]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66, portal: 172.16.0.220,3260] successful.
Nov 15 15:56:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8106b958-4341-47df-98ea-e6c6bde73e66 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97c702b-9b15-4e82-a01b-27883739fd1e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== disconnect_volume: return (300ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:56:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1dff36ee-009c-493a-adc7-7bdeaae23f51 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:56:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:56:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:56:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:12 user nova-compute[75095]: INFO nova.compute.manager [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Unrescuing
Nov 15 15:57:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:57:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:12 user nova-compute[75095]: DEBUG nova.objects.instance [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'flavor' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:13 user nova-compute[75095]: WARNING nova.compute.manager [req-42ed2e80-0ed7-4dd9-ae2f-3ba3abe14ea2 req-ab8d4e58-e03d-4b39-aaaa-831386630326 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance destroyed successfully.
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:15 user nova-compute[75095]: WARNING nova.compute.manager [req-7a409580-71a6-4530-ac3a-f7f8e468f734 req-0c565bc2-bdbf-46c9-8ba3-62b8f440094a service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state rescued and task_state unrescuing.
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:15 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:57:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-69fc7e52-9240-4144-b2a8-892c2ef2d3d2 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG nova.objects.instance [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:17 user nova-compute[75095]: INFO nova.compute.manager [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attaching volume e302b81e-d30e-41ad-9a67-df99aa8275ff to /dev/vdb
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.utils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28b43a0-3e37-4e5b-9d58-98f2496eeb64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71fc9d1-9c68-4208-a486-63b9ab66fa74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[80261ad6-0fbe-4f45-beca-317e07100ef6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e406a21-3934-4d5b-8160-53c5b45e4b4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:57:17 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:57:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f72644-190c-4199-90ef-95abc501a23f]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG os_brick.utils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:17 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating existing volume attachment record: 47308d0f-2434-48dc-bfad-77a28e6aa6c4 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:57:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxpCLKGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:22 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:22 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:22 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb03eefd-fddf-49e8-9edb-95df2c6f70e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:57:22 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37664bba-c9c0-4cf2-80c0-ba4a87f5e913]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff] added
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa547ae6-e661-43e9-983f-32287cb2d5cf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50310441-d83b-4813-b79a-e55a1e6c4ef0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxpCLKGk {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AxpCLKGk" returned: 0 in 0.030s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b5d84-b59a-4ca5-8c39-5543c0468686]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AxpCLKGk'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[101809fe-1b58-4045-bc88-be4edc76d139]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10f6ab-a9e1-4067-ba09-457b40bb3761]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9f8680-21f0-4909-bb3c-7d8fd09290fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260]
Nov 15 15:57:22 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260] successful.
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[75353b02-6368-4d69-90b0-165725fd2368]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8405b98d-95de-4527-8638-c8f99c7c1e15]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:22 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a808def1-79ab-44c0-be2a-870508bc1e0b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:57:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxpCLKGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23639616533626235', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639616533626235', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 15:57:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:57:23 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:57:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:57:23 user nova-compute[75095]:   <serial>e302b81e-d30e-41ad-9a67-df99aa8275ff</serial>
Nov 15 15:57:23 user nova-compute[75095]: </disk>
Nov 15 15:57:23 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] No VIF found with MAC fa:16:3e:5e:69:d0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-add60954-0dac-4c6f-81cf-1ba3d73b76bc tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.235s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:26 user nova-compute[75095]: INFO nova.compute.manager [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Detaching volume e302b81e-d30e-41ad-9a67-df99aa8275ff
Nov 15 15:57:26 user nova-compute[75095]: INFO nova.virt.block_device [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Attempting to driver detach volume e302b81e-d30e-41ad-9a67-df99aa8275ff from mountpoint /dev/vdb
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Attempting to detach device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:57:26 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:57:26 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:57:26 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:57:26 user nova-compute[75095]:   <serial>e302b81e-d30e-41ad-9a67-df99aa8275ff</serial>
Nov 15 15:57:26 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:57:26 user nova-compute[75095]: </disk>
Nov 15 15:57:26 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:57:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the persistent domain config.
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 15:57:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 15:57:26 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:57:26 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 15:57:26 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 15:57:26 user nova-compute[75095]:   <serial>e302b81e-d30e-41ad-9a67-df99aa8275ff</serial>
Nov 15 15:57:26 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 15:57:26 user nova-compute[75095]: </disk>
Nov 15 15:57:26 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 15:57:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:57:27 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7762MB free_disk=24.381546020507812GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "b9836a76-0313-4058-857f-777075521311-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:27 user nova-compute[75095]: INFO nova.compute.manager [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Terminating instance
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Applying migration context for instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 as it has an incoming, in-progress migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7. Migration status is finished {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 15:57:27 user nova-compute[75095]: INFO nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating resource usage from migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7
Nov 15 15:57:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b9836a76-0313-4058-857f-777075521311 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-unplugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] Acquiring lock "b9836a76-0313-4058-857f-777075521311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] [instance: b9836a76-0313-4058-857f-777075521311] No waiting events found dispatching network-vif-unplugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-89312afd-5a46-4118-bbaf-4d34e1595350 req-f094f76f-3602-4aa8-9719-9432724c6e9a service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-unplugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b9836a76-0313-4058-857f-777075521311] Instance destroyed successfully.
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lazy-loading 'resources' on Instance uuid b9836a76-0313-4058-857f-777075521311 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1166690213',display_name='tempest-VolumesAdminNegativeTest-server-1166690213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1166690213',id=28,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWUnq9xDWAeWFhOAmDdHjXxAw8s3XyERIAQNZUXOfdnoobFbnVeyHeRcQlFcnK9MshbcLaSBww2yCLZye7g4TIyBaPO2lgSDP3RpfiiSdn2+bXAJ/C6dTAgg/ob15F9hQ==',key_name='tempest-keypair-219902262',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:51:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc1e4e79a5944d438bfacae28fd86ada',ramdisk_id='',reservation_id='r-5hvu01wb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1780720036',owner_user_name='tempest-VolumesAdminNegativeTest-1780720036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:51:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='07d584f2b0224d5aa6569a95556e0365',uuid=b9836a76-0313-4058-857f-777075521311,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converting VIF {"id": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "address": "fa:16:3e:4c:92:f5", "network": {"id": "71a0d707-2c37-4022-819a-830b382f0e29", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-319250720-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc1e4e79a5944d438bfacae28fd86ada", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebc29e8f-23", "ovs_interfaceid": "ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG os_vif [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebc29e8f-23, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69d63bd5-7552-46d9-9658-18e42ea2417e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:28 user nova-compute[75095]: INFO os_vif [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:92:f5,bridge_name='br-int',has_traffic_filtering=True,id=ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b,network=Network(71a0d707-2c37-4022-819a-830b382f0e29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebc29e8f-23')
Nov 15 15:57:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Deleting instance files /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311_del
Nov 15 15:57:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Deletion of /opt/stack/data/nova/instances/b9836a76-0313-4058-857f-777075521311_del complete
Nov 15 15:57:28 user nova-compute[75095]: INFO nova.compute.manager [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] [instance: b9836a76-0313-4058-857f-777075521311] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 15:57:28 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: b9836a76-0313-4058-857f-777075521311] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b9836a76-0313-4058-857f-777075521311] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:57:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b9836a76-0313-4058-857f-777075521311] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:29 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: b9836a76-0313-4058-857f-777075521311] Took 0.86 seconds to deallocate network for instance.
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Going to confirm migration 2 {{(pid=75095) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:29 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Deleted allocations for instance b9836a76-0313-4058-857f-777075521311
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] Acquiring lock "b9836a76-0313-4058-857f-777075521311-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] Lock "b9836a76-0313-4058-857f-777075521311-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] [instance: b9836a76-0313-4058-857f-777075521311] No waiting events found dispatching network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:29 user nova-compute[75095]: WARNING nova.compute.manager [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received unexpected event network-vif-plugged-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b for instance with vm_state deleted and task_state None.
Nov 15 15:57:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-0a76bc77-6e2f-44c7-8f9f-01daabff0283 req-f16af108-984b-4113-94c0-f941fc91361d service nova] [instance: b9836a76-0313-4058-857f-777075521311] Received event network-vif-deleted-ebc29e8f-23f2-4fb0-9b0e-28cec90b7f4b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e88d6638-2283-4a45-a339-149b2974c239 tempest-VolumesAdminNegativeTest-1780720036 tempest-VolumesAdminNegativeTest-1780720036-project-member] Lock "b9836a76-0313-4058-857f-777075521311" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.400s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquired lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'info_cache' on Instance uuid c63a3174-966d-4ce8-95c3-53a8b817a2a3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [{"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Releasing lock "refresh_cache-c63a3174-966d-4ce8-95c3-53a8b817a2a3" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'migration_context' on Instance uuid c63a3174-966d-4ce8-95c3-53a8b817a2a3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG nova.objects.base [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Object Instance<c63a3174-966d-4ce8-95c3-53a8b817a2a3> lazy-loaded attributes: info_cache,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:31 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:57:31 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:57:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.345s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:31 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Deleted allocation for migration fd7c3c9a-2a48-4226-be73-76e3aa8362e7
Nov 15 15:57:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-284f4435-70a3-4d40-87a4-d4a8cd47d948 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.621s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-changed-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Refreshing instance network info cache due to event network-changed-58e89d65-b423-49b3-b43d-a606f25cf3f1. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] Acquiring lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] Acquired lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Refreshing network info cache for port 58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updated VIF entry in instance network info cache for port 58e89d65-b423-49b3-b43d-a606f25cf3f1. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.network.neutron [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating instance_info_cache with network_info: [{"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6bbcaf85-edf5-4eba-a1ff-79d78bae9e18 req-90420d49-b655-4293-805e-44383bd8c0a2 service nova] Releasing lock "refresh_cache-9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:38 user nova-compute[75095]: INFO nova.compute.manager [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Terminating instance
Nov 15 15:57:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Instance destroyed successfully.
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.objects.instance [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:55:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-221347918',display_name='tempest-TestVolumeBootPattern-server-221347918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-221347918',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:55:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-xluvdlna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:55:57Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "address": "fa:16:3e:7f:67:72", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58e89d65-b4", "ovs_interfaceid": "58e89d65-b423-49b3-b43d-a606f25cf3f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_vif [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58e89d65-b4, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=172100ec-52b0-43ac-9025-1455b132f3f0) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:39 user nova-compute[75095]: INFO os_vif [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:67:72,bridge_name='br-int',has_traffic_filtering=True,id=58e89d65-b423-49b3-b43d-a606f25cf3f1,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58e89d65-b4')
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:39 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2388740-0a84-4c21-bc66-5d982f13101a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:57:39 user nova-compute[75095]: No targets found.
Nov 15 15:57:39 user nova-compute[75095]: iSNS:
Nov 15 15:57:39 user nova-compute[75095]: No targets found.
Nov 15 15:57:39 user nova-compute[75095]: STATIC:
Nov 15 15:57:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff
Nov 15 15:57:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:57:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:57:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:39 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 15:57:39 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:39 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:39 user nova-compute[75095]: FIRMWARE:
Nov 15 15:57:39 user nova-compute[75095]: No targets found.
Nov 15 15:57:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:57:39 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:57:39 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f36f72-d5d5-499f-9b78-9824d1f93e3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbca0999-9ffd-4d84-b09f-8bc9016da397]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:57:39 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c273400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2620e-7f87-4b8a-9a99-accefd1cc489]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bdb752-f0ea-4d57-8c70-dda691139025]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd23d62-2d2a-477b-be48-9b136352f35e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[71975e9f-27df-4daf-907b-32723f44c339]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd55e6-de09-4c07-880d-05b59991d346]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ff2aa2-78e2-4c4b-8ebb-799fd07b558d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]
Nov 15 15:57:39 user nova-compute[75095]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.
Nov 15 15:57:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f3ea80-af48-46cd-8354-87646747d0df]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (321ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:57:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Deleting instance files /opt/stack/data/nova/instances/9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7_del
Nov 15 15:57:39 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Deletion of /opt/stack/data/nova/instances/9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7_del complete
Nov 15 15:57:40 user nova-compute[75095]: INFO nova.compute.manager [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-unplugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] No waiting events found dispatching network-vif-unplugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-unplugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Acquiring lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] No waiting events found dispatching network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:40 user nova-compute[75095]: WARNING nova.compute.manager [req-f81ec422-c08b-41b9-a549-1dfbbef71920 req-b9423944-058f-46d7-9b08-b398c6a9fc43 service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received unexpected event network-vif-plugged-58e89d65-b423-49b3-b43d-a606f25cf3f1 for instance with vm_state active and task_state deleting.
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:40 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Took 0.79 seconds to deallocate network for instance.
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-ae85709e-ddf4-49d2-92d6-fd3335c15427 req-ba8284b9-452e-49d9-9654-fdd899a8846b service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Received event network-vif-deleted-58e89d65-b423-49b3-b43d-a606f25cf3f1 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:40 user nova-compute[75095]: INFO nova.compute.manager [req-ae85709e-ddf4-49d2-92d6-fd3335c15427 req-ba8284b9-452e-49d9-9654-fdd899a8846b service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Neutron deleted interface 58e89d65-b423-49b3-b43d-a606f25cf3f1; detaching it from the instance and deleting it from the info cache
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.network.neutron [req-ae85709e-ddf4-49d2-92d6-fd3335c15427 req-ba8284b9-452e-49d9-9654-fdd899a8846b service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-ae85709e-ddf4-49d2-92d6-fd3335c15427 req-ba8284b9-452e-49d9-9654-fdd899a8846b service nova] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Detach interface failed, port_id=58e89d65-b423-49b3-b43d-a606f25cf3f1, reason: Instance 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 15:57:42 user nova-compute[75095]: INFO nova.compute.manager [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7] Took 1.97 seconds to detach 1 volumes for instance.
Nov 15 15:57:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:43 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance 9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-60f9f85e-1743-4f19-ad43-918b4f120353 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "9ef4d84e-ff64-4b8c-8e7f-94bc9cc6c8c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.641s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:43 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:57:43 user nova-compute[75095]: INFO nova.compute.claims [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Claim successful on node user
Nov 15 15:57:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:57:44 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.policy [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e464dcfa23814b2798c8738730374dff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '146bfea92e9f4bf3b6996aac094f9e43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:57:44 user nova-compute[75095]: INFO nova.virt.block_device [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Booting with volume-backed-image 42c1c869-d893-4140-8d14-8f5bfccef902 at /dev/vda
Nov 15 15:57:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Successfully created port: 9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Successfully updated port: 9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-changed-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Refreshing instance network info cache due to event network-changed-9fc2f0c5-de35-4c21-8d68-b03e1e42be39. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] Acquiring lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:57:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating instance_info_cache with network_info: [{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance network_info: |[{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] Acquired lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Refreshing network info cache for port 9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updated VIF entry in instance network info cache for port 9fc2f0c5-de35-4c21-8d68-b03e1e42be39. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating instance_info_cache with network_info: [{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:57:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5b9d9c11-c70f-47a3-b83a-1d2864803b9d req-bb1f6b88-c303-4b73-a056-7997f3c289c2 service nova] Releasing lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:57:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 is timed out.
Nov 15 15:57:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully detached device vdb from instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 from the live domain config.
Nov 15 15:57:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AxpCLKGk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:47 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9937293c-ced0-4a3d-b680-77d82c5bc500]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 15:57:47 user nova-compute[75095]: No targets found.
Nov 15 15:57:47 user nova-compute[75095]: iSNS:
Nov 15 15:57:47 user nova-compute[75095]: No targets found.
Nov 15 15:57:47 user nova-compute[75095]: STATIC:
Nov 15 15:57:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff
Nov 15 15:57:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 15:57:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:47 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 15:57:47 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 15:57:47 user nova-compute[75095]:                 Iface Name: default
Nov 15 15:57:47 user nova-compute[75095]: FIRMWARE:
Nov 15 15:57:47 user nova-compute[75095]: No targets found.
Nov 15 15:57:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 15:57:47 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 15:57:47 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df2479-e576-46ae-920d-25ed208c7208]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda0edb7-14c5-4efb-a7df-7619b44edc57]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:47 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:47 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:47 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:47 user nova-compute[75095]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff (non-flash)
Nov 15 15:57:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e46f135-a1af-4c15-9398-725f3d38064f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb655a9b-52a9-4072-aca6-dff41fb4eea4]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5388bf-779a-4c13-9637-5525648ae30d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90729f89-02ea-4073-a833-ea8014c03a6a]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.130s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42836e78-2479-4a6f-8122-3eb03fe81d17]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99bda24-6150-4b4a-893d-0d54dd6bbdd8]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260]
Nov 15 15:57:47 user nova-compute[75095]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff, portal: 172.16.0.220,3260] successful.
Nov 15 15:57:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e302b81e-d30e-41ad-9a67-df99aa8275ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2c3440-0675-4ea0-9a83-e7b4e298c768]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] <== disconnect_volume: return (396ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 15:57:48 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'flavor' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0953e106-c4d1-415e-ad54-27ddbc649bc3 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.900s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72470cf-dd9d-4002-bc65-06ee2b54d772]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad2d69-f28c-4b82-a9bc-7bb86f2ccc45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155bb3e-93e4-4530-bbdb-20ecd1294f54]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd205067-ac7a-4cf9-a35b-352304f7610c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:57:50 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:57:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b487686-41e3-4cb4-aecd-0548dd95340c]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:50 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating existing volume attachment record: 6187e0a8-a1dd-4ca5-ba4c-40182b1d1e35 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:57:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:57:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Creating image(s)
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Ensure instance console log exists: /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start _get_guest_xml network_info=[{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '6187e0a8-a1dd-4ca5-ba4c-40182b1d1e35', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4caf1ff5-2201-454c-a281-858e96175bab', 'attached_at': '', 'detached_at': '', 'volume_id': 'f801279c-b736-4d16-a8a7-c5b6138697bd', 'serial': 'f801279c-b736-4d16-a8a7-c5b6138697bd'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:57:55 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:57:55 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:57:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:57:55 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b638d7-7a1c-43de-a202-38dae803c4d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:57:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[184d6b2b-c9f8-4616-8266-e8088dbe47b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd] added
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc961f87-0ae4-4841-b792-3a228d0b31b1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a433b3da-b5b0-4ba5-a76c-dc95f21e9a81]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxJqeZba {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxJqeZba" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91670264-0e6c-4fec-9e77-7a7c640c8699]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxJqeZba'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57afaff-c116-4539-9487-ff98c968145c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aa76b8-70c9-4ded-80e5-4d2a952002ae]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f90137-5250-47ba-893f-4fbd0f5aa931]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260]
Nov 15 15:57:55 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260] successful.
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b28e786-6f4a-4e54-96fb-55faf228a760]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af39629-0d8b-4a3f-bcc2-6e31634d2053]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:57:55 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:57:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b594cb-9745-40f3-97d9-9e87bfc29a34]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:57:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23531643333626533', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643333626533', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431249798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431249798',id=36,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-5sy1pa47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:57:44Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=4caf1ff5-2201-454c-a281-858e96175bab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:57:56 user nova-compute[75095]:   <uuid>4caf1ff5-2201-454c-a281-858e96175bab</uuid>
Nov 15 15:57:56 user nova-compute[75095]:   <name>instance-00000024</name>
Nov 15 15:57:56 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:57:56 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:57:56 user nova-compute[75095]:   <metadata>
Nov 15 15:57:56 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:57:56 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-431249798</nova:name>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:57:55</nova:creationTime>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:57:56 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:57:56 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:owner>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:57:56 user nova-compute[75095]:       </nova:owner>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:57:56 user nova-compute[75095]:       <nova:ports>
Nov 15 15:57:56 user nova-compute[75095]:         <nova:port uuid="9fc2f0c5-de35-4c21-8d68-b03e1e42be39">
Nov 15 15:57:56 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 15:57:56 user nova-compute[75095]:         </nova:port>
Nov 15 15:57:56 user nova-compute[75095]:       </nova:ports>
Nov 15 15:57:56 user nova-compute[75095]:     </nova:instance>
Nov 15 15:57:56 user nova-compute[75095]:   </metadata>
Nov 15 15:57:56 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:57:56 user nova-compute[75095]:     <system>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="serial">4caf1ff5-2201-454c-a281-858e96175bab</entry>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="uuid">4caf1ff5-2201-454c-a281-858e96175bab</entry>
Nov 15 15:57:56 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:57:56 user nova-compute[75095]:     </system>
Nov 15 15:57:56 user nova-compute[75095]:   </sysinfo>
Nov 15 15:57:56 user nova-compute[75095]:   <os>
Nov 15 15:57:56 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:57:56 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:57:56 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:57:56 user nova-compute[75095]:   </os>
Nov 15 15:57:56 user nova-compute[75095]:   <features>
Nov 15 15:57:56 user nova-compute[75095]:     <acpi/>
Nov 15 15:57:56 user nova-compute[75095]:     <apic/>
Nov 15 15:57:56 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:57:56 user nova-compute[75095]:   </features>
Nov 15 15:57:56 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:57:56 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:57:56 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:57:56 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:57:56 user nova-compute[75095]:   </clock>
Nov 15 15:57:56 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:57:56 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:57:56 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:57:56 user nova-compute[75095]:   </cpu>
Nov 15 15:57:56 user nova-compute[75095]:   <devices>
Nov 15 15:57:56 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:57:56 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:57:56 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:57:56 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:57:56 user nova-compute[75095]:       <serial>f801279c-b736-4d16-a8a7-c5b6138697bd</serial>
Nov 15 15:57:56 user nova-compute[75095]:     </disk>
Nov 15 15:57:56 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:57:56 user nova-compute[75095]:       <mac address="fa:16:3e:2b:70:c1"/>
Nov 15 15:57:56 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:57:56 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:57:56 user nova-compute[75095]:       <target dev="tap9fc2f0c5-de"/>
Nov 15 15:57:56 user nova-compute[75095]:     </interface>
Nov 15 15:57:56 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:57:56 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/console.log" append="off"/>
Nov 15 15:57:56 user nova-compute[75095]:     </serial>
Nov 15 15:57:56 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:57:56 user nova-compute[75095]:     <video>
Nov 15 15:57:56 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:57:56 user nova-compute[75095]:     </video>
Nov 15 15:57:56 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:57:56 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:57:56 user nova-compute[75095]:     </rng>
Nov 15 15:57:56 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:57:56 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:57:56 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:57:56 user nova-compute[75095]:     </memballoon>
Nov 15 15:57:56 user nova-compute[75095]:   </devices>
Nov 15 15:57:56 user nova-compute[75095]: </domain>
Nov 15 15:57:56 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431249798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431249798',id=36,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-5sy1pa47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:57:44Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=4caf1ff5-2201-454c-a281-858e96175bab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG os_vif [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7eb2cce6-fae4-50a3-9d24-1b8a04ec83d2', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fc2f0c5-de, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fc2f0c5-de, col_values=(('qos', UUID('33243eb1-348c-4ec0-8ffc-454d20bc6151')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fc2f0c5-de, col_values=(('external_ids', {'iface-id': '9fc2f0c5-de35-4c21-8d68-b03e1e42be39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:70:c1', 'vm-uuid': '4caf1ff5-2201-454c-a281-858e96175bab'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:57:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:56 user nova-compute[75095]: INFO os_vif [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de')
Nov 15 15:57:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:57:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:2b:70:c1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:57:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:57:58 user nova-compute[75095]: WARNING nova.compute.manager [req-a7d3ffbf-cbf1-4060-8cc3-f904aed4aa4b req-0722a0fd-123b-4456-9f3b-ec665d95928c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state building and task_state spawning.
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:58:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance spawned successfully.
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:58:00 user nova-compute[75095]: WARNING nova.compute.manager [req-2d3d6641-d836-4508-8fb3-a11bb1203923 req-eae3105a-226c-4eaf-9fbf-ea98e411c195 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state building and task_state spawning.
Nov 15 15:58:00 user nova-compute[75095]: INFO nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 15 15:58:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:58:00 user nova-compute[75095]: INFO nova.compute.manager [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Took 17.05 seconds to build instance.
Nov 15 15:58:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-53f69430-19be-4ae1-bbd6-bdf09581c730 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.172s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 15:58:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 15:58:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:58:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:58:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 15:58:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:58:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:29 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:58:29 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7873MB free_disk=24.397003173828125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 4caf1ff5-2201-454c-a281-858e96175bab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 15:58:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.936s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 15:58:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:58:31 user nova-compute[75095]: INFO nova.compute.claims [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Claim successful on node user
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:58:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:58:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:58:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:31 user nova-compute[75095]: INFO nova.virt.block_device [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Booting with volume 4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 at /dev/vda
Nov 15 15:58:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.utils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5559daf5-98be-4b21-8d19-fab47e335669]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e62976-228a-43ad-b1d9-96acc9ed66e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e456abe-e4f3-475d-b565-343df374aca3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e71134-5845-4308-be9b-e2700134bfa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:58:32 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9710d9ec-dde6-46c7-8b62-9fdf23726a98]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG os_brick.utils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating existing volume attachment record: d4cb5366-1ff0-43f9-a2be-91abb42bb535 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG nova.policy [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:33 user nova-compute[75095]: INFO nova.compute.manager [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Terminating instance
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-unplugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] No waiting events found dispatching network-vif-unplugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-368f30d1-00ae-49fc-b341-e2797f604996 req-0e7309a6-5d60-49d3-98f0-91e6cfc060f9 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-unplugged-98eb3d10-702d-4bc6-9630-91d167a5b06c for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Successfully created port: b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Instance destroyed successfully.
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lazy-loading 'resources' on Instance uuid 7e5b52ab-eebc-4194-b588-7b688f7f2ba3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:52:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-258778721',display_name='tempest-SnapshotDataIntegrityTests-server-258778721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-258778721',id=30,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYluKDxOSgC6Y4I0JihtXQgPLt3qnXu3JuZD36OT+RWECWZgtJhupOLAEN5606o93IM7z+8RKEL9DwEKoItruKhmalMZakmUCDF7TfVatREPEngE0zLNdqjGATanv+smA==',key_name='tempest-keypair-1444610908',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:52:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7f44d10e736d40559bb878cfd0b21326',ramdisk_id='',reservation_id='r-0fnpbyt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2139963622',owner_user_name='tempest-SnapshotDataIntegrityTests-2139963622-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:52:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2bb770140d8b49f89d13559e60ebd61a',uuid=7e5b52ab-eebc-4194-b588-7b688f7f2ba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converting VIF {"id": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "address": "fa:16:3e:5e:69:d0", "network": {"id": "f1a71175-0ce0-4360-9cdd-472349ed7c56", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1859122669-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7f44d10e736d40559bb878cfd0b21326", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98eb3d10-70", "ovs_interfaceid": "98eb3d10-702d-4bc6-9630-91d167a5b06c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG os_vif [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98eb3d10-70, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa4614b0-9fe5-421f-9057-f012ee779251) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:33 user nova-compute[75095]: INFO os_vif [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:69:d0,bridge_name='br-int',has_traffic_filtering=True,id=98eb3d10-702d-4bc6-9630-91d167a5b06c,network=Network(f1a71175-0ce0-4360-9cdd-472349ed7c56),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98eb3d10-70')
Nov 15 15:58:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Deleting instance files /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3_del
Nov 15 15:58:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Deletion of /opt/stack/data/nova/instances/7e5b52ab-eebc-4194-b588-7b688f7f2ba3_del complete
Nov 15 15:58:33 user nova-compute[75095]: INFO nova.compute.manager [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 15 15:58:33 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 15:58:33 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Successfully updated port: b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing instance network info cache due to event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] Acquiring lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:58:35 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Took 1.43 seconds to deallocate network for instance.
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] Acquiring lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] No waiting events found dispatching network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:58:35 user nova-compute[75095]: WARNING nova.compute.manager [req-2b4b4e04-5aaa-4578-b435-3f8bd561448c req-406e6f1f-6ebb-4bdd-b9a1-99d9526d1dab service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received unexpected event network-vif-plugged-98eb3d10-702d-4bc6-9630-91d167a5b06c for instance with vm_state active and task_state deleting.
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Instance network_info: |[{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] Acquired lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.network.neutron [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:35 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Deleted allocations for instance 7e5b52ab-eebc-4194-b588-7b688f7f2ba3
Nov 15 15:58:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5f712010-e19e-4940-a4b2-27f74c4ebd38 tempest-SnapshotDataIntegrityTests-2139963622 tempest-SnapshotDataIntegrityTests-2139963622-project-member] Lock "7e5b52ab-eebc-4194-b588-7b688f7f2ba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.940s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:36 user nova-compute[75095]: DEBUG nova.network.neutron [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updated VIF entry in instance network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:58:36 user nova-compute[75095]: DEBUG nova.network.neutron [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:58:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa71a192-0904-46a0-8210-c0784364aa3b req-c4aeca77-0128-4df6-b21d-8dd2bf551d0a service nova] Releasing lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-ab4f4870-dcbb-47ac-ab13-3a11417c4db0 req-490717e7-2942-4cbf-bcea-2059f7e8f994 service nova] [instance: 7e5b52ab-eebc-4194-b588-7b688f7f2ba3] Received event network-vif-deleted-98eb3d10-702d-4bc6-9630-91d167a5b06c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:58:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Creating image(s)
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Ensure instance console log exists: /opt/stack/data/nova/instances/ec7bc0c6-c339-49e8-94b9-f0cb87154756/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Start _get_guest_xml network_info=[{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': 'd4cb5366-1ff0-43f9-a2be-91abb42bb535', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ec7bc0c6-c339-49e8-94b9-f0cb87154756', 'attached_at': '', 'detached_at': '', 'volume_id': '4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'serial': '4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:58:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:58:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:58:37 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:58:37 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:58:37 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e440c-1b38-4797-aa54-de03e712dcd2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:58:37 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6448e6ff-119e-4d03-91a0-32dca3dfbb34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335] added
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f52bb6-f372-4556-abdd-c7368fa77d80]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d9283a-c574-46b6-ab2f-b58276eba99d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxtRwJqj {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OxtRwJqj" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f6912-52cc-42ba-9851-5df70a857430]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OxtRwJqj'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[722974ef-d04c-4047-b15f-cc40a39c1e74]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7996c75-df68-46bf-9127-7c995d5357a4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d01381c-3873-4544-8284-74870a5a8921]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]
Nov 15 15:58:37 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7610d23b-6dfc-4f66-a4da-248f83013ac7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1161dc67-e035-44f8-8c27-53d77e54c45c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:58:37 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:58:37 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94b987-11ff-449c-b904-c1b5641f2b31]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:58:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23937356532343534', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937356532343534', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1679251584',display_name='tempest-TestVolumeBootPattern-server-1679251584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1679251584',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-djeu0ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:32Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=ec7bc0c6-c339-49e8-94b9-f0cb87154756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid ec7bc0c6-c339-49e8-94b9-f0cb87154756 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:58:38 user nova-compute[75095]:   <uuid>ec7bc0c6-c339-49e8-94b9-f0cb87154756</uuid>
Nov 15 15:58:38 user nova-compute[75095]:   <name>instance-00000025</name>
Nov 15 15:58:38 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:58:38 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:58:38 user nova-compute[75095]:   <metadata>
Nov 15 15:58:38 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:58:38 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:58:38 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-server-1679251584</nova:name>
Nov 15 15:58:38 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:58:37</nova:creationTime>
Nov 15 15:58:38 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:58:38 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:58:38 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:58:38 user nova-compute[75095]:       <nova:owner>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 15:58:38 user nova-compute[75095]:       </nova:owner>
Nov 15 15:58:38 user nova-compute[75095]:       <nova:ports>
Nov 15 15:58:38 user nova-compute[75095]:         <nova:port uuid="b84d29d2-9f88-4c67-b3b7-5d03b7409e65">
Nov 15 15:58:38 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 15:58:38 user nova-compute[75095]:         </nova:port>
Nov 15 15:58:38 user nova-compute[75095]:       </nova:ports>
Nov 15 15:58:38 user nova-compute[75095]:     </nova:instance>
Nov 15 15:58:38 user nova-compute[75095]:   </metadata>
Nov 15 15:58:38 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:58:38 user nova-compute[75095]:     <system>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="serial">ec7bc0c6-c339-49e8-94b9-f0cb87154756</entry>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="uuid">ec7bc0c6-c339-49e8-94b9-f0cb87154756</entry>
Nov 15 15:58:38 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:58:38 user nova-compute[75095]:     </system>
Nov 15 15:58:38 user nova-compute[75095]:   </sysinfo>
Nov 15 15:58:38 user nova-compute[75095]:   <os>
Nov 15 15:58:38 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:58:38 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:58:38 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:58:38 user nova-compute[75095]:   </os>
Nov 15 15:58:38 user nova-compute[75095]:   <features>
Nov 15 15:58:38 user nova-compute[75095]:     <acpi/>
Nov 15 15:58:38 user nova-compute[75095]:     <apic/>
Nov 15 15:58:38 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:58:38 user nova-compute[75095]:   </features>
Nov 15 15:58:38 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:58:38 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:58:38 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:58:38 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:58:38 user nova-compute[75095]:   </clock>
Nov 15 15:58:38 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:58:38 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:58:38 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:58:38 user nova-compute[75095]:   </cpu>
Nov 15 15:58:38 user nova-compute[75095]:   <devices>
Nov 15 15:58:38 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:58:38 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:58:38 user nova-compute[75095]:       <source dev="/dev/sdd"/>
Nov 15 15:58:38 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:58:38 user nova-compute[75095]:       <serial>4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335</serial>
Nov 15 15:58:38 user nova-compute[75095]:     </disk>
Nov 15 15:58:38 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:58:38 user nova-compute[75095]:       <mac address="fa:16:3e:55:4c:55"/>
Nov 15 15:58:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:58:38 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:58:38 user nova-compute[75095]:       <target dev="tapb84d29d2-9f"/>
Nov 15 15:58:38 user nova-compute[75095]:     </interface>
Nov 15 15:58:38 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:58:38 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/ec7bc0c6-c339-49e8-94b9-f0cb87154756/console.log" append="off"/>
Nov 15 15:58:38 user nova-compute[75095]:     </serial>
Nov 15 15:58:38 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:58:38 user nova-compute[75095]:     <video>
Nov 15 15:58:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:58:38 user nova-compute[75095]:     </video>
Nov 15 15:58:38 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:58:38 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:58:38 user nova-compute[75095]:     </rng>
Nov 15 15:58:38 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:58:38 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:58:38 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:58:38 user nova-compute[75095]:     </memballoon>
Nov 15 15:58:38 user nova-compute[75095]:   </devices>
Nov 15 15:58:38 user nova-compute[75095]: </domain>
Nov 15 15:58:38 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1679251584',display_name='tempest-TestVolumeBootPattern-server-1679251584',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1679251584',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-djeu0ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:32Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=ec7bc0c6-c339-49e8-94b9-f0cb87154756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG os_vif [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b60df45-0257-52d9-8b14-ce06df6c9b16', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb84d29d2-9f, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb84d29d2-9f, col_values=(('qos', UUID('fbfb6634-fce6-427a-8834-7ee0a3a23d5e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb84d29d2-9f, col_values=(('external_ids', {'iface-id': 'b84d29d2-9f88-4c67-b3b7-5d03b7409e65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:4c:55', 'vm-uuid': 'ec7bc0c6-c339-49e8-94b9-f0cb87154756'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:38 user nova-compute[75095]: INFO os_vif [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f')
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:58:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:55:4c:55, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:58:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:58:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Instance spawned successfully.
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:58:42 user nova-compute[75095]: INFO nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 15 15:58:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:58:42 user nova-compute[75095]: INFO nova.compute.manager [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Took 11.33 seconds to build instance.
Nov 15 15:58:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-85e5375d-05f3-4d27-9db7-c049418ef891 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.427s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] No waiting events found dispatching network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:58:46 user nova-compute[75095]: WARNING nova.compute.manager [req-c036ae2c-ea8b-410f-9592-6101f175b637 req-38a6d496-466c-4f3e-98ad-14f8290dc042 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received unexpected event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 for instance with vm_state active and task_state None.
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] No waiting events found dispatching network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:58:48 user nova-compute[75095]: WARNING nova.compute.manager [req-d659e0a6-f0aa-4795-bd46-bd09f8ce0721 req-cc93b787-3df0-4def-8739-08f445782ffd service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received unexpected event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 for instance with vm_state active and task_state None.
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 8590b8bb-61ea-4e65-826e-c8e0caf4620e {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid c63a3174-966d-4ce8-95c3-53a8b817a2a3 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 7ba34aca-dade-4f88-bdda-c8b4837f87aa {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid ec7bc0c6-c339-49e8-94b9-f0cb87154756 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "4caf1ff5-2201-454c-a281-858e96175bab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "4caf1ff5-2201-454c-a281-858e96175bab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:58:55 user nova-compute[75095]: INFO nova.compute.claims [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Claim successful on node user
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:58:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:58:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:58:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:58:56 user nova-compute[75095]: INFO nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Booting with volume a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 at /dev/vda
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG nova.policy [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a7525313ce3491e8e5b45ca9abfefff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3febf29b62f048d587c6a2b53ab24795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab601ec7-48a2-42c7-836f-068599eb4ff6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9789f5cc-d301-493e-ab2d-0d0e0b2164aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f006811-cd4b-43d0-8ccc-48766431a07d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c72cd4-8bcc-4886-9af2-8d6ef3bb67ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:58:56 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:58:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e42f0ad-cfa6-426e-85db-3ac579c394ad]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating existing volume attachment record: 2965b944-b0e7-4191-90cf-cb00992e5f67 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:58:56 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully created port: d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully created port: 26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully created port: 585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully created port: d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully created port: 7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-d03bebad-135e-434e-a97c-6f28c62d3e86. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:58:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-57daab9a-1547-449d-a580-a037917e0cb0 req-45932a15-e406-4c6a-8b8a-1770d576667f service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: 21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:01 user nova-compute[75095]: INFO nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Booting with volume 9f840484-b956-4597-8011-11efa95fa7e5 at /dev/vdb
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe66ea0-79d1-4441-b20e-b39363995141]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8008cbf-aab1-4447-9a31-fab59a4f05b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f2c43-6834-4fa6-a861-559703329601]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca37690-4a30-4cf3-8bec-f906adc7cd96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:59:01 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[384df1e8-d0a7-49d0-8d69-bb99a3112b7a]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating existing volume attachment record: 2b158b95-6183-422d-91b6-663cb766edd8 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: 26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-f2e18ee6-1682-4e10-9749-8287299df4a8. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-21769566-20c9-427e-8e66-6a7eb344cae0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port 21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-26e867c8-e236-40ec-b4e1-b062ab6d7032. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port 26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: 585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-45472c09-2323-488f-89cc-8779a896a11d req-bcb3d200-bd71-45a3-970d-a93ae37190d0 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port 585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:03 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-d8aaade1-4bfb-4720-9aed-57f27ffd264d. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Successfully updated port: 7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20ba9784-ed24-4a09-b4b4-f3e78dcafcf5 req-37847b9f-2003-436c-9de7-f216a18c5143 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:59:04 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-7cae3321-a206-46cc-8f3e-39ebf418580b. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:06 user nova-compute[75095]: INFO nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Booting with volume 403e83a5-a791-4e70-a32f-d1e93b1802aa at /dev/vdc
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f94223-c097-46b5-8f2a-d40d9e0078c0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21d7324-0376-4835-bec3-bc4fbe3db62c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda273ac-5659-4c1b-b899-953228cfe6ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d05c64-7948-4502-8c9d-3c0162055009]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 15:59:06 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755b19f-11d2-40a5-8393-820004b1acb2]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG os_brick.utils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating existing volume attachment record: 512f8830-5b6d-4d75-bb14-6562aec24f45 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [{"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance network_info: |[{"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port 7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updated VIF entry in instance network info cache for port 7cae3321-a206-46cc-8f3e-39ebf418580b. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [{"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 15:59:07 user nova-compute[75095]: INFO nova.compute.claims [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Claim successful on node user
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dc56938f-97e1-499e-bf0b-94968cb29813 req-537c531c-d551-4178-b04b-8d97c954129e service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 15:59:07 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 15:59:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.policy [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b373d886288b4895a2b41b26063db3fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0cf29264b1f4e38982c483eed3bf857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:59:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Creating image(s)
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk 1073741824" returned: 0 in 0.067s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Successfully created port: 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Cannot resize image /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Ensure instance console log exists: /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Successfully updated port: 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing instance network info cache due to event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance network_info: |[{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start _get_guest_xml network_info=[{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:59:09 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:09 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361455939',display_name='tempest-ServerRescueNegativeTestJSON-server-1361455939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361455939',id=39,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH16vexSVhF620msGDtWMag6BC8oQ3f6Ef/hJMnQ2BpKkMsdp37K7Dy9QN5mmlZ2H1yxg444oTk17ObM4mDUGwSA+whErFBkOYOWejIcffMyo3PzJ4Irx4OONjwrcDgUrw==',key_name='tempest-keypair-1716535491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-dpa0cmvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b373d886288b4895a2b41b26063db3fa',uuid=2fac940f-34d2-401e-ad63-b60436b81807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:59:09 user nova-compute[75095]:   <uuid>2fac940f-34d2-401e-ad63-b60436b81807</uuid>
Nov 15 15:59:09 user nova-compute[75095]:   <name>instance-00000027</name>
Nov 15 15:59:09 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:59:09 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:59:09 user nova-compute[75095]:   <metadata>
Nov 15 15:59:09 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:59:09 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1361455939</nova:name>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:59:09</nova:creationTime>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:59:09 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:59:09 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:owner>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 15:59:09 user nova-compute[75095]:       </nova:owner>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:59:09 user nova-compute[75095]:       <nova:ports>
Nov 15 15:59:09 user nova-compute[75095]:         <nova:port uuid="85c7b24d-5d78-4a1a-904c-002d4a0276aa">
Nov 15 15:59:09 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 15:59:09 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:09 user nova-compute[75095]:       </nova:ports>
Nov 15 15:59:09 user nova-compute[75095]:     </nova:instance>
Nov 15 15:59:09 user nova-compute[75095]:   </metadata>
Nov 15 15:59:09 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:59:09 user nova-compute[75095]:     <system>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="serial">2fac940f-34d2-401e-ad63-b60436b81807</entry>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="uuid">2fac940f-34d2-401e-ad63-b60436b81807</entry>
Nov 15 15:59:09 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:59:09 user nova-compute[75095]:     </system>
Nov 15 15:59:09 user nova-compute[75095]:   </sysinfo>
Nov 15 15:59:09 user nova-compute[75095]:   <os>
Nov 15 15:59:09 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:59:09 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:59:09 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:59:09 user nova-compute[75095]:   </os>
Nov 15 15:59:09 user nova-compute[75095]:   <features>
Nov 15 15:59:09 user nova-compute[75095]:     <acpi/>
Nov 15 15:59:09 user nova-compute[75095]:     <apic/>
Nov 15 15:59:09 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:59:09 user nova-compute[75095]:   </features>
Nov 15 15:59:09 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:59:09 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:59:09 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:59:09 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:59:09 user nova-compute[75095]:   </clock>
Nov 15 15:59:09 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:59:09 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:59:09 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:59:09 user nova-compute[75095]:   </cpu>
Nov 15 15:59:09 user nova-compute[75095]:   <devices>
Nov 15 15:59:09 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:59:09 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:59:09 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk"/>
Nov 15 15:59:09 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:59:09 user nova-compute[75095]:     </disk>
Nov 15 15:59:09 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:09 user nova-compute[75095]:       <mac address="fa:16:3e:62:b4:08"/>
Nov 15 15:59:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:09 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:09 user nova-compute[75095]:       <target dev="tap85c7b24d-5d"/>
Nov 15 15:59:09 user nova-compute[75095]:     </interface>
Nov 15 15:59:09 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:59:09 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/console.log" append="off"/>
Nov 15 15:59:09 user nova-compute[75095]:     </serial>
Nov 15 15:59:09 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:59:09 user nova-compute[75095]:     <video>
Nov 15 15:59:09 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:09 user nova-compute[75095]:     </video>
Nov 15 15:59:09 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:59:09 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:59:09 user nova-compute[75095]:     </rng>
Nov 15 15:59:09 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:59:09 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:59:09 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:59:09 user nova-compute[75095]:     </memballoon>
Nov 15 15:59:09 user nova-compute[75095]:   </devices>
Nov 15 15:59:09 user nova-compute[75095]: </domain>
Nov 15 15:59:09 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361455939',display_name='tempest-ServerRescueNegativeTestJSON-server-1361455939',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361455939',id=39,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH16vexSVhF620msGDtWMag6BC8oQ3f6Ef/hJMnQ2BpKkMsdp37K7Dy9QN5mmlZ2H1yxg444oTk17ObM4mDUGwSA+whErFBkOYOWejIcffMyo3PzJ4Irx4OONjwrcDgUrw==',key_name='tempest-keypair-1716535491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-dpa0cmvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b373d886288b4895a2b41b26063db3fa',uuid=2fac940f-34d2-401e-ad63-b60436b81807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG os_vif [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebf0bd06-35bf-5879-bceb-46b7e67b706b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85c7b24d-5d, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85c7b24d-5d, col_values=(('qos', UUID('beb0730b-5609-41e5-99ea-cf953b865801')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85c7b24d-5d, col_values=(('external_ids', {'iface-id': '85c7b24d-5d78-4a1a-904c-002d4a0276aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:b4:08', 'vm-uuid': '2fac940f-34d2-401e-ad63-b60436b81807'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:09 user nova-compute[75095]: INFO os_vif [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d')
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:62:b4:08, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updated VIF entry in instance network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG nova.network.neutron [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3f3c5630-d167-462d-804b-11ee502964f2 req-16dc407a-e27a-41fa-b2b2-9ec6bb6f6afe service nova] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:11 user nova-compute[75095]: WARNING nova.compute.manager [req-43a146c2-6d2f-485f-9ada-bcbe4bab9851 req-f5145563-2e78-4d41-93c1-0091cc304e38 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state building and task_state spawning.
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 15:59:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Creating image(s)
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Ensure instance console log exists: /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Start _get_guest_xml network_info=[{"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '2965b944-b0e7-4191-90cf-cb00992e5f67', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGirQkdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 'serial': 'a0f6567b-8ee2-48aa-ba5f-c645b0ca9145'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'attachment_id': '2b158b95-6183-422d-91b6-663cb766edd8', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 1, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCaxOSHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58', 'attached_at': '', 'detached_at': '', 'volume_id': '9f840484-b956-4597-8011-11efa95fa7e5', 'serial': '9f840484-b956-4597-8011-11efa95fa7e5'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'attachment_id': '512f8830-5b6d-4d75-bb14-6562aec24f45', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 2, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktDVzLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58', 'attached_at': '', 'detached_at': '', 'volume_id': '403e83a5-a791-4e70-a32f-d1e93b1802aa', 'serial': '403e83a5-a791-4e70-a32f-d1e93b1802aa'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:59:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGirQkdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:11 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:11 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:11 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47e4a82-feb5-45f8-9c3e-184781315054]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:59:11 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88a8bf-e2b2-467c-8a1e-81640e3403e7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145] added
Nov 15 15:59:11 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0a5e55-464f-4ff5-a9f9-e72d86e44348]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c076a41-ecee-4afe-a93c-8454cb1860b7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGirQkdA {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EGirQkdA" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2694ec5-98ee-4634-86f5-e92999988109]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EGirQkdA'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66223408-abc2-4c70-8bbc-8894bca8beb5]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cc4c0c-77e4-4357-abd9-c8738b4148ea]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a707fe-ffe2-4bd5-87b0-ad06b5d8148b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260]
Nov 15 15:59:12 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260] successful.
Nov 15 15:59:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87cd9b-5d36-48f4-8d4b-a8b54843b41e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa9dec2-5bf8-4896-bb29-1a169a182630]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:12 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fffa8b8-c83e-4978-aea3-f81d02f6ec16]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:59:12 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGirQkdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:59:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance spawned successfully.
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26135633535646431', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135633535646431', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCaxOSHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:13 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:13 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:13 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d84c37-44c8-4f5e-9556-25d66fba5d4c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:59:13 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: INFO nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Took 5.14 seconds to spawn the instance on the hypervisor.
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08af994-f7ba-4454-9715-a6225be6e350]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5] added
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9acd6f9-7dd3-48ee-8dd8-076126d0004b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:13 user nova-compute[75095]: WARNING nova.compute.manager [req-3b7c24b0-a46e-4061-aa72-3eb6116e2856 req-01c84682-6c42-4c67-bc48-fa661349c7b6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state building and task_state spawning.
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35a151-9fff-4c45-89ba-ec92717f2a98]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: INFO nova.compute.manager [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Took 5.96 seconds to build instance.
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCaxOSHE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f7205e1-0de9-4d56-8657-ca254e770bd4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.054s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hCaxOSHE" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ed209-0731-41f5-9f27-682f3e4d06c4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hCaxOSHE'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd880a5-0646-4e6b-a344-5298e2167037]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[58412a6c-6bf0-4d87-943b-d526f4f158ac]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0a29b2-d7c4-4c98-80f1-310abc1c361b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260]
Nov 15 15:59:13 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260] successful.
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[246939c0-efa7-43f9-b7bf-d785d5d65dfc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5033ac32-2596-459a-b0cf-b781c33378e1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:13 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2867dc0b-f32d-4b6c-9f33-c45b9be90b02]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCaxOSHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:59:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '23661666165666562', 'path': '/dev/sdg'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661666165666562', 'path': '/dev/sdg'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktDVzLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:14 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:14 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1b1829-9836-4a3a-8a50-d5a1f4e21c10]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 15:59:14 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9c0893-c4ec-4668-bf03-22fcaeb66739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa] added
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8e624f-079c-47f2-864d-7e73bd89c8e0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f0382-8684-42df-a9a5-7e60fe7120b4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktDVzLga {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ktDVzLga" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fce77fa-0083-446d-bf0f-3f22cf68e75b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ktDVzLga'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e428ff-e428-474a-8f4a-6b8b02396755]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c616405-3d66-4c1c-97f7-e1afe7309212]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e56e17-057c-4522-a8ee-3ddbd6dce368]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260]
Nov 15 15:59:14 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260] successful.
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9f5876-bd8c-4e84-ac85-691c1250849c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f4873e-fe5b-4d3b-b54b-fcabfe4a1530]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:14 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 15:59:14 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] HCTL ('39', '-', '-', 0) found on session 48 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1ef779-9bab-4783-8391-b9b1b22837f5]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:14 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching for a device in session 48 and hctl ['39', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:59:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Searching for a device in session 48 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:59:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktDVzLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:59:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26430633030383766', 'path': '/dev/sdh'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430633030383766', 'path': '/dev/sdh'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b22028b-f825-4f5c-bb33-f6ce7cae0c58 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:59:16 user nova-compute[75095]:   <uuid>7b22028b-f825-4f5c-bb33-f6ce7cae0c58</uuid>
Nov 15 15:59:16 user nova-compute[75095]:   <name>instance-00000026</name>
Nov 15 15:59:16 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:59:16 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:59:16 user nova-compute[75095]:   <metadata>
Nov 15 15:59:16 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:59:16 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:name>tempest-device-tagging-server-835567113</nova:name>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:59:11</nova:creationTime>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:59:16 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:59:16 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:owner>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:user uuid="0a7525313ce3491e8e5b45ca9abfefff">tempest-TaggedBootDevicesTest-731424877-project-member</nova:user>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:project uuid="3febf29b62f048d587c6a2b53ab24795">tempest-TaggedBootDevicesTest-731424877</nova:project>
Nov 15 15:59:16 user nova-compute[75095]:       </nova:owner>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:59:16 user nova-compute[75095]:       <nova:ports>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="d03bebad-135e-434e-a97c-6f28c62d3e86">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="f2e18ee6-1682-4e10-9749-8287299df4a8">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="21769566-20c9-427e-8e66-6a7eb344cae0">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="26e867c8-e236-40ec-b4e1-b062ab6d7032">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.4" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="585238c9-9efd-4aa2-8d36-0d39ac9c8f5a">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.1.1.215" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="d8aaade1-4bfb-4720-9aed-57f27ffd264d">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:         <nova:port uuid="7cae3321-a206-46cc-8f3e-39ebf418580b">
Nov 15 15:59:16 user nova-compute[75095]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 15:59:16 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:16 user nova-compute[75095]:       </nova:ports>
Nov 15 15:59:16 user nova-compute[75095]:     </nova:instance>
Nov 15 15:59:16 user nova-compute[75095]:   </metadata>
Nov 15 15:59:16 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:59:16 user nova-compute[75095]:     <system>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="serial">7b22028b-f825-4f5c-bb33-f6ce7cae0c58</entry>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="uuid">7b22028b-f825-4f5c-bb33-f6ce7cae0c58</entry>
Nov 15 15:59:16 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:59:16 user nova-compute[75095]:     </system>
Nov 15 15:59:16 user nova-compute[75095]:   </sysinfo>
Nov 15 15:59:16 user nova-compute[75095]:   <os>
Nov 15 15:59:16 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:59:16 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 15:59:16 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:59:16 user nova-compute[75095]:   </os>
Nov 15 15:59:16 user nova-compute[75095]:   <features>
Nov 15 15:59:16 user nova-compute[75095]:     <acpi/>
Nov 15 15:59:16 user nova-compute[75095]:     <apic/>
Nov 15 15:59:16 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:59:16 user nova-compute[75095]:   </features>
Nov 15 15:59:16 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:59:16 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:59:16 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:59:16 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:59:16 user nova-compute[75095]:   </clock>
Nov 15 15:59:16 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:59:16 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:59:16 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:59:16 user nova-compute[75095]:   </cpu>
Nov 15 15:59:16 user nova-compute[75095]:   <devices>
Nov 15 15:59:16 user nova-compute[75095]:     <disk type="file" device="cdrom">
Nov 15 15:59:16 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 15:59:16 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/disk.config"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="hda" bus="ide"/>
Nov 15 15:59:16 user nova-compute[75095]:     </disk>
Nov 15 15:59:16 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:59:16 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:59:16 user nova-compute[75095]:       <source dev="/dev/sde"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <serial>a0f6567b-8ee2-48aa-ba5f-c645b0ca9145</serial>
Nov 15 15:59:16 user nova-compute[75095]:     </disk>
Nov 15 15:59:16 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:59:16 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:59:16 user nova-compute[75095]:       <source dev="/dev/sdg"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <serial>9f840484-b956-4597-8011-11efa95fa7e5</serial>
Nov 15 15:59:16 user nova-compute[75095]:     </disk>
Nov 15 15:59:16 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:59:16 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:59:16 user nova-compute[75095]:       <source dev="/dev/sdh"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="vdc" bus="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <serial>403e83a5-a791-4e70-a32f-d1e93b1802aa</serial>
Nov 15 15:59:16 user nova-compute[75095]:     </disk>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:6d:55:39"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tapd03bebad-13"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:ed:16:f8"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tapf2e18ee6-16"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:65:58:91"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tap21769566-20"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:e6:51:9c"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tap26e867c8-e2"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:89:c6:d1"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tap585238c9-9e"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:d1:0e:93"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tapd8aaade1-4b"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:16 user nova-compute[75095]:       <mac address="fa:16:3e:ce:f7:eb"/>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:16 user nova-compute[75095]:       <target dev="tap7cae3321-a2"/>
Nov 15 15:59:16 user nova-compute[75095]:     </interface>
Nov 15 15:59:16 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:59:16 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/console.log" append="off"/>
Nov 15 15:59:16 user nova-compute[75095]:     </serial>
Nov 15 15:59:16 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:59:16 user nova-compute[75095]:     <video>
Nov 15 15:59:16 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:16 user nova-compute[75095]:     </video>
Nov 15 15:59:16 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:59:16 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:59:16 user nova-compute[75095]:     </rng>
Nov 15 15:59:16 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:59:16 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:59:16 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:59:16 user nova-compute[75095]:     </memballoon>
Nov 15 15:59:16 user nova-compute[75095]:   </devices>
Nov 15 15:59:16 user nova-compute[75095]: </domain>
Nov 15 15:59:16 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2360897c-ac00-5820-bb2a-7dc85164735d', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd03bebad-13, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd03bebad-13, col_values=(('qos', UUID('e982a8d1-209f-4540-87c3-6c83e8cdd80e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd03bebad-13, col_values=(('external_ids', {'iface-id': 'd03bebad-135e-434e-a97c-6f28c62d3e86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:55:39', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a400564-a76b-58bc-9404-c0b958360909', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2e18ee6-16, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2e18ee6-16, col_values=(('qos', UUID('de4ee6bb-be0d-4297-992e-ef7b54f994ca')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2e18ee6-16, col_values=(('external_ids', {'iface-id': 'f2e18ee6-1682-4e10-9749-8287299df4a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:16:f8', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f03cafe2-8fcd-50ac-a338-e61056d3e534', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21769566-20, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21769566-20, col_values=(('qos', UUID('a556ccd9-dec4-4e71-a8c0-d344dda7674d')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21769566-20, col_values=(('external_ids', {'iface-id': '21769566-20c9-427e-8e66-6a7eb344cae0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:58:91', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b95e716-990b-5bf4-adec-4dd2ce31d3c3', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e867c8-e2, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26e867c8-e2, col_values=(('qos', UUID('ef31331f-7b09-4e6c-bfc2-4ff1674f9f45')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26e867c8-e2, col_values=(('external_ids', {'iface-id': '26e867c8-e236-40ec-b4e1-b062ab6d7032', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:51:9c', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e745f42a-62c3-5aa0-b6fb-4fa091edcf78', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap585238c9-9e, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap585238c9-9e, col_values=(('qos', UUID('c1118d64-b9ba-43a5-917e-33755c07c35c')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap585238c9-9e, col_values=(('external_ids', {'iface-id': '585238c9-9efd-4aa2-8d36-0d39ac9c8f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:c6:d1', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f748cccd-84bc-54d6-9045-c51df0494478', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8aaade1-4b, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8aaade1-4b, col_values=(('qos', UUID('b7a5387a-bc96-4b15-a634-35771a31c324')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8aaade1-4b, col_values=(('external_ids', {'iface-id': 'd8aaade1-4bfb-4720-9aed-57f27ffd264d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:0e:93', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a809dc04-f8de-5a79-8f19-d1a115c05a99', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cae3321-a2, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cae3321-a2, col_values=(('qos', UUID('161e0be2-2a5b-4d69-9c6d-4e9442121ab1')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cae3321-a2, col_values=(('external_ids', {'iface-id': '7cae3321-a206-46cc-8f3e-39ebf418580b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f7:eb', 'vm-uuid': '7b22028b-f825-4f5c-bb33-f6ce7cae0c58'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:16 user nova-compute[75095]: INFO os_vif [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2')
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] No BDM found with device name hda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] No VIF found with MAC fa:16:3e:6d:55:39, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] No VIF found with MAC fa:16:3e:89:c6:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:59:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Using config drive
Nov 15 15:59:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 15:59:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Creating config drive at /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/disk.config
Nov 15 15:59:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqzbk4jfj {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqzbk4jfj" returned: 0 in 0.074s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:18 user nova-compute[75095]: WARNING nova.compute.manager [req-aa306fb0-e2b9-41ff-b3ed-47e2c3926088 req-d6ad95ec-c30f-428a-a99e-40760e84df3d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 for instance with vm_state building and task_state spawning.
Nov 15 15:59:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:19 user nova-compute[75095]: WARNING nova.compute.manager [req-b8df4a1b-0a1c-43bf-892c-cf3982708a1d req-8a8fcb00-0195-4736-bb92-471fb4ef33e1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 for instance with vm_state building and task_state spawning.
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:19 user nova-compute[75095]: WARNING nova.compute.manager [req-d89d872c-42f3-42b6-aa09-e3e245d84f99 req-9d3fea79-a7df-47c8-9dfd-d9712d462f41 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a for instance with vm_state building and task_state spawning.
Nov 15 15:59:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:20 user nova-compute[75095]: WARNING nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 for instance with vm_state building and task_state spawning.
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:20 user nova-compute[75095]: WARNING nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 for instance with vm_state building and task_state spawning.
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:20 user nova-compute[75095]: WARNING nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 for instance with vm_state building and task_state spawning.
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:20 user nova-compute[75095]: WARNING nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d for instance with vm_state building and task_state spawning.
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:20 user nova-compute[75095]: WARNING nova.compute.manager [req-785b5efd-73f5-4c24-b65b-7969dba694bb req-26a751a2-d881-417b-b70a-677ef6421c93 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: INFO nova.compute.manager [None req-fe888f0f-3b9c-4243-aa0b-676718205bef tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Get console output
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-16f10e79-4381-46ef-9186-2ba673956487 req-03741cb1-e984-47b1-b2fc-6d1d96ec9ab5 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:21 user nova-compute[75095]: WARNING nova.compute.manager [req-e25f8f31-0116-4435-a41e-bfa0e88f494a req-39650d26-263b-4661-8d18-a0aa94b364fd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b for instance with vm_state building and task_state spawning.
Nov 15 15:59:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 15:59:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance spawned successfully.
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:22 user nova-compute[75095]: INFO nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Took 10.93 seconds to spawn the instance on the hypervisor.
Nov 15 15:59:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:59:22 user nova-compute[75095]: INFO nova.compute.manager [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Took 27.42 seconds to build instance.
Nov 15 15:59:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c2f44215-0581-4996-9d91-2125d88d5bac tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.514s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:30 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:30 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7573MB free_disk=24.367401123046875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c63a3174-966d-4ce8-95c3-53a8b817a2a3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 4caf1ff5-2201-454c-a281-858e96175bab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec7bc0c6-c339-49e8-94b9-f0cb87154756 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7b22028b-f825-4f5c-bb33-f6ce7cae0c58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 15:59:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 15:59:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 15:59:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:34 user nova-compute[75095]: INFO nova.compute.manager [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Rescuing
Nov 15 15:59:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 15:59:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 15:59:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG nova.network.neutron [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating instance_info_cache with network_info: [{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:35 user nova-compute[75095]: WARNING nova.compute.manager [req-e73f79ca-9deb-4496-bb99-ac1f12f69737 req-d259bc58-d661-4c52-bf2b-fc04a9aa580c service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state active and task_state rescuing.
Nov 15 15:59:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:36 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance destroyed successfully.
Nov 15 15:59:36 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Attempting a stable device rescue
Nov 15 15:59:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 15:59:36 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Creating image(s)
Nov 15 15:59:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG nova.virt.images [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] d13b1c89-1471-41b7-a10c-7838db070550 was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.part /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.part /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.converted" returned: 0 in 0.305s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:37 user nova-compute[75095]: WARNING nova.compute.manager [req-bb1cd2df-6b45-4e54-a6e1-0c54ad9e173f req-1dc8dd19-87e1-4042-a2ef-91463ebb1c83 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state active and task_state rescuing.
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.624s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b,backing_fmt=raw /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b,backing_fmt=raw /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue" returned: 0 in 0.046s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "9f11c94c332425c9da07ff60ef3809ccd84b077b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'migration_context' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<4caf1ff5-2201-454c-a281-858e96175bab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start _get_guest_xml network_info=[{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:2b:70:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd13b1c89-1471-41b7-a10c-7838db070550', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '6187e0a8-a1dd-4ca5-ba4c-40182b1d1e35', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '4caf1ff5-2201-454c-a281-858e96175bab', 'attached_at': '', 'detached_at': '', 'volume_id': 'f801279c-b736-4d16-a8a7-c5b6138697bd', 'serial': 'f801279c-b736-4d16-a8a7-c5b6138697bd'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<4caf1ff5-2201-454c-a281-858e96175bab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'numa_topology' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<4caf1ff5-2201-454c-a281-858e96175bab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:59:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<4caf1ff5-2201-454c-a281-858e96175bab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 15:59:38 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:38 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 15:59:38 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee682cb4-e118-47f8-a1ef-bc7a40afb599]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = oxJqeZba\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 15:59:38 user nova-compute[75095]: node.name = iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 15:59:38 user nova-compute[75095]: node.tpgt = -1
Nov 15 15:59:38 user nova-compute[75095]: node.startup = automatic
Nov 15 15:59:38 user nova-compute[75095]: node.leading_login = No
Nov 15 15:59:38 user nova-compute[75095]: iface.iscsi_ifacename = default
Nov 15 15:59:38 user nova-compute[75095]: iface.net_ifacename = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.ipaddress = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.prefix_len = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.hwaddress = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.transport_name = tcp
Nov 15 15:59:38 user nova-compute[75095]: iface.initiatorname = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.vlan_id = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.vlan_priority = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.vlan_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.iface_num = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.mtu = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.port = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.bootproto = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.subnet_mask = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.gateway = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_alt_client_id = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_dns = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_learn_iqn = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_vendor_id_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_vendor_id = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.dhcp_slp_da = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.fragmentation = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.gratuitous_arp = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.incoming_forwarding = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.tos_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.tos = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.ttl = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.delayed_ack = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.tcp_nagle = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.tcp_wsf_state = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.tcp_wsf = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.tcp_timer_scale = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.tcp_timestamp = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.redirect = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.def_task_mgmt_timeout = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.header_digest = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.data_digest = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.immediate_data = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.initial_r2t = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.data_seq_inorder = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.data_pdu_inorder = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.erl = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.max_receive_data_len = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.first_burst_len = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.max_outstanding_r2t = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.max_burst_len = 0
Nov 15 15:59:38 user nova-compute[75095]: iface.chap_auth = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.bidi_chap = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.strict_login_compliance = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.discovery_auth = <empty>
Nov 15 15:59:38 user nova-compute[75095]: iface.discovery_logout = <empty>
Nov 15 15:59:38 user nova-compute[75095]: node.discovery_address = <empty>
Nov 15 15:59:38 user nova-compute[75095]: node.discovery_port = 0
Nov 15 15:59:38 user nova-compute[75095]: node.discovery_type = static
Nov 15 15:59:38 user nova-compute[75095]: node.session.initial_cmdsn = 0
Nov 15 15:59:38 user nova-compute[75095]: node.session.initial_login_retry_max = 8
Nov 15 15:59:38 user nova-compute[75095]: node.session.xmit_thread_priority = -20
Nov 15 15:59:38 user nova-compute[75095]: node.session.cmds_max = 128
Nov 15 15:59:38 user nova-compute[75095]: node.session.queue_depth = 32
Nov 15 15:59:38 user nova-compute[75095]: node.session.nr_sessions = 1
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.authmethod = CHAP
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.username = oxJqeZba
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.password = ***
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.username_in = <empty>
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.password_in = <empty>
Nov 15 15:59:38 user nova-compute[75095]: node.session.auth.chap_algs = MD5
Nov 15 15:59:38 user nova-compute[75095]: node.session.timeo.replacement_timeout = 120
Nov 15 15:59:38 user nova-compute[75095]: node.session.err_timeo.abort_timeout = 15
Nov 15 15:59:38 user nova-compute[75095]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 15:59:38 user nova-compute[75095]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 15:59:38 user nova-compute[75095]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.FastAbort = Yes
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.InitialR2T = No
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.ImmediateData = Yes
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.MaxConnections = 1
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 15:59:38 user nova-compute[75095]: node.session.iscsi.ERL = 0
Nov 15 15:59:38 user nova-compute[75095]: node.session.scan = manual
Nov 15 15:59:38 user nova-compute[75095]: node.session.reopen_max = 0
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].address = 172.16.0.220
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].port = 3260
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].startup = manual
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].tcp.window_size = 524288
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].tcp.type_of_service = 0
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].timeo.logout_timeout = 15
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].timeo.login_timeout = 15
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].timeo.auth_timeout = 45
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.DataDigest = None
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.IFMarker = No
Nov 15 15:59:38 user nova-compute[75095]: node.conn[0].iscsi.OFMarker = No
Nov 15 15:59:38 user nova-compute[75095]: # END RECORD
Nov 15 15:59:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9322c98d-940a-46ed-8704-ac9fcc89028b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad534817-02a8-4ce5-8c21-b38d693549bb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxJqeZba {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxJqeZba" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5e078f-8d29-4cf3-987a-6ec0a9813414]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxJqeZba'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0480ff8-d17e-4d82-9731-f08cb61c1169]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71d2db1-7a2b-4d69-b70c-f34d83dcea5e]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 15:59:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 15:59:38 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 15:59:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] HCTL ('34', '0', '0', 0) found on session 44 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf1cd3f-86c3-4dff-b2d4-385a57a91c38]: (4, ('0 0 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Searching for a device in session 44 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.182s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '23531643333626533', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531643333626533', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431249798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431249798',id=36,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:58:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-5sy1pa47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:58:01Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=4caf1ff5-2201-454c-a281-858e96175bab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:2b:70:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "vif_mac": "fa:16:3e:2b:70:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'pci_devices' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.objects.base [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Object Instance<4caf1ff5-2201-454c-a281-858e96175bab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] End _get_guest_xml xml=<domain type="kvm">
Nov 15 15:59:38 user nova-compute[75095]:   <uuid>4caf1ff5-2201-454c-a281-858e96175bab</uuid>
Nov 15 15:59:38 user nova-compute[75095]:   <name>instance-00000024</name>
Nov 15 15:59:38 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 15:59:38 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 15:59:38 user nova-compute[75095]:   <metadata>
Nov 15 15:59:38 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 15:59:38 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-431249798</nova:name>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:creationTime>2023-11-15 15:59:38</nova:creationTime>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 15:59:38 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 15:59:38 user nova-compute[75095]:       </nova:flavor>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:owner>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:user uuid="e464dcfa23814b2798c8738730374dff">tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member</nova:user>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:project uuid="146bfea92e9f4bf3b6996aac094f9e43">tempest-ServerBootFromVolumeStableRescueTest-146545434</nova:project>
Nov 15 15:59:38 user nova-compute[75095]:       </nova:owner>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 15:59:38 user nova-compute[75095]:       <nova:ports>
Nov 15 15:59:38 user nova-compute[75095]:         <nova:port uuid="9fc2f0c5-de35-4c21-8d68-b03e1e42be39">
Nov 15 15:59:38 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 15:59:38 user nova-compute[75095]:         </nova:port>
Nov 15 15:59:38 user nova-compute[75095]:       </nova:ports>
Nov 15 15:59:38 user nova-compute[75095]:     </nova:instance>
Nov 15 15:59:38 user nova-compute[75095]:   </metadata>
Nov 15 15:59:38 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 15:59:38 user nova-compute[75095]:     <system>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="serial">4caf1ff5-2201-454c-a281-858e96175bab</entry>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="uuid">4caf1ff5-2201-454c-a281-858e96175bab</entry>
Nov 15 15:59:38 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 15:59:38 user nova-compute[75095]:     </system>
Nov 15 15:59:38 user nova-compute[75095]:   </sysinfo>
Nov 15 15:59:38 user nova-compute[75095]:   <os>
Nov 15 15:59:38 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 15:59:38 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 15:59:38 user nova-compute[75095]:   </os>
Nov 15 15:59:38 user nova-compute[75095]:   <features>
Nov 15 15:59:38 user nova-compute[75095]:     <acpi/>
Nov 15 15:59:38 user nova-compute[75095]:     <apic/>
Nov 15 15:59:38 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 15:59:38 user nova-compute[75095]:   </features>
Nov 15 15:59:38 user nova-compute[75095]:   <clock offset="utc">
Nov 15 15:59:38 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 15:59:38 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 15:59:38 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 15:59:38 user nova-compute[75095]:   </clock>
Nov 15 15:59:38 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 15:59:38 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 15:59:38 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 15:59:38 user nova-compute[75095]:   </cpu>
Nov 15 15:59:38 user nova-compute[75095]:   <devices>
Nov 15 15:59:38 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 15:59:38 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 15:59:38 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 15:59:38 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 15:59:38 user nova-compute[75095]:       <serial>f801279c-b736-4d16-a8a7-c5b6138697bd</serial>
Nov 15 15:59:38 user nova-compute[75095]:     </disk>
Nov 15 15:59:38 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 15:59:38 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 15:59:38 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue"/>
Nov 15 15:59:38 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 15:59:38 user nova-compute[75095]:       <boot order="1"/>
Nov 15 15:59:38 user nova-compute[75095]:     </disk>
Nov 15 15:59:38 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 15:59:38 user nova-compute[75095]:       <mac address="fa:16:3e:2b:70:c1"/>
Nov 15 15:59:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:38 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 15:59:38 user nova-compute[75095]:       <target dev="tap9fc2f0c5-de"/>
Nov 15 15:59:38 user nova-compute[75095]:     </interface>
Nov 15 15:59:38 user nova-compute[75095]:     <serial type="pty">
Nov 15 15:59:38 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/console.log" append="off"/>
Nov 15 15:59:38 user nova-compute[75095]:     </serial>
Nov 15 15:59:38 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 15:59:38 user nova-compute[75095]:     <video>
Nov 15 15:59:38 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 15:59:38 user nova-compute[75095]:     </video>
Nov 15 15:59:38 user nova-compute[75095]:     <rng model="virtio">
Nov 15 15:59:38 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 15:59:38 user nova-compute[75095]:     </rng>
Nov 15 15:59:38 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 15:59:38 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 15:59:38 user nova-compute[75095]:       <stats period="10"/>
Nov 15 15:59:38 user nova-compute[75095]:     </memballoon>
Nov 15 15:59:38 user nova-compute[75095]:   </devices>
Nov 15 15:59:38 user nova-compute[75095]: </domain>
Nov 15 15:59:38 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 15:59:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance destroyed successfully.
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] No VIF found with MAC fa:16:3e:2b:70:c1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 15:59:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:39 user nova-compute[75095]: WARNING nova.compute.manager [req-c4a41db2-7ed8-4370-a6d2-ae6d4fa164c6 req-e01667e3-ac7e-4989-9cbd-2e027c14cab9 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state active and task_state rescuing.
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ac9c55c4-bc1c-49aa-9601-122026a72657 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 15:59:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 15:59:41 user nova-compute[75095]: WARNING nova.compute.manager [req-584311bf-47ad-4f37-95f7-55b274c358e5 req-75d2d970-3b8f-4ab0-a588-30929e02270f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state rescued and task_state None.
Nov 15 15:59:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 15:59:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:00:16 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:00:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [{"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-6bff7d80-06e7-4219-a602-6c6be1fef714" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:00:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:21 user nova-compute[75095]: INFO nova.compute.manager [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Terminating instance
Nov 15 16:00:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-521d58b1-899c-413f-a81c-9aadda0f7a50 req-5bfadafe-a7b8-4554-ac4f-515328e57aff service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-unplugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Instance destroyed successfully.
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'resources' on Instance uuid c63a3174-966d-4ce8-95c3-53a8b817a2a3 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-831689889',display_name='tempest-ServerActionsTestOtherA-server-831689889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-831689889',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:55:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-zkpj6i2c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=c63a3174-966d-4ce8-95c3-53a8b817a2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "da912a65-e75f-4457-8721-8e8cb7fc5065", "address": "fa:16:3e:d1:11:75", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda912a65-e7", "ovs_interfaceid": "da912a65-e75f-4457-8721-8e8cb7fc5065", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_vif [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda912a65-e7, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6dce46fa-c65e-4541-ad68-d55a585c7a70) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:22 user nova-compute[75095]: INFO os_vif [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:11:75,bridge_name='br-int',has_traffic_filtering=True,id=da912a65-e75f-4457-8721-8e8cb7fc5065,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda912a65-e7')
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jeFNWxSX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:22 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06fa13b-3878-43ff-ac25-9ff7fa0b1e57]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:00:22 user nova-compute[75095]: No targets found.
Nov 15 16:00:22 user nova-compute[75095]: iSNS:
Nov 15 16:00:22 user nova-compute[75095]: No targets found.
Nov 15 16:00:22 user nova-compute[75095]: STATIC:
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:00:22 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:22 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:22 user nova-compute[75095]: FIRMWARE:
Nov 15 16:00:22 user nova-compute[75095]: No targets found.
Nov 15 16:00:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:00:22 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:00:22 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ee08e0-c75c-459e-a65d-a78eb6586f4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f4d7cd-663a-40cf-8fcc-3c7be4b6ee7c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:22 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdb0824-0e3d-40fc-bf60-e2d3f844f7a2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5ed45-f3ab-4bca-b87e-95fd13527e15]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4b584-7877-41f7-90b0-a0feb588641b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9530bc5-8963-4854-ad6b-c6f73f5c07b9]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e29abb-a284-42fe-91fd-4bd21d7bbe8c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a1600-190c-4254-ba37-0b3ac1650527]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260]
Nov 15 16:00:22 user nova-compute[75095]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1, portal: 172.16.0.220,3260] successful.
Nov 15 16:00:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing instance network info cache due to event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] Acquiring lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] Acquired lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c59e98-65e8-4447-bcb4-52253fecafe1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5fef79-7a69-42eb-83c2-4336bf85e2ed]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] <== disconnect_volume: return (370ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:00:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Deleting instance files /opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3_del
Nov 15 16:00:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Deletion of /opt/stack/data/nova/instances/c63a3174-966d-4ce8-95c3-53a8b817a2a3_del complete
Nov 15 16:00:22 user nova-compute[75095]: INFO nova.compute.manager [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 16:00:22 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:00:22 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updated VIF entry in instance network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ad6f2ea6-95eb-4311-84c6-6b45a3076d39 req-32990275-0a1a-4701-8047-b059ddb97ffe service nova] Releasing lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:23 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Took 1.12 seconds to deallocate network for instance.
Nov 15 16:00:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] Acquiring lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] No waiting events found dispatching network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:24 user nova-compute[75095]: WARNING nova.compute.manager [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received unexpected event network-vif-plugged-da912a65-e75f-4457-8721-8e8cb7fc5065 for instance with vm_state active and task_state deleting.
Nov 15 16:00:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-d5adbcff-c291-4aee-81b3-bed993541c4f req-c70bdd7a-dc05-45e2-8214-2d7486a2a6c9 service nova] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Received event network-vif-deleted-da912a65-e75f-4457-8721-8e8cb7fc5065 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:24 user nova-compute[75095]: INFO nova.compute.manager [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Took 0.80 seconds to detach 1 volumes for instance.
Nov 15 16:00:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: c63a3174-966d-4ce8-95c3-53a8b817a2a3] Deleting volume: 53c59e98-65e8-4447-bcb4-52253fecafe1 {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:25 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:00:25 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:00:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:25 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Deleted allocations for instance c63a3174-966d-4ce8-95c3-53a8b817a2a3
Nov 15 16:00:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-520defc5-a813-4019-bf78-5e0b42394a6e tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "c63a3174-966d-4ce8-95c3-53a8b817a2a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.564s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:00:29 user nova-compute[75095]: INFO nova.compute.claims [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Claim successful on node user
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.policy [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f02f7b31bee84b1790581da3ffa3c249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411ae82aac4242d6a14fd6625204b8fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:00:30 user nova-compute[75095]: INFO nova.virt.block_device [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Booting with volume 6a8a89ca-fffe-4285-87f9-487e843a5132 at /dev/vda
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.utils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a669b34-e566-4bc3-bf42-3f66222bac34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[300aa95a-6235-4447-aaf6-c41ff0889900]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa66c1-e0bd-4630-847f-8e1a810a8b30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f048c52f-6729-4fab-bc66-56e2c9b50ace]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:00:30 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ad07dc-3f66-4236-a5cf-7dbf66518fdb]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG os_brick.utils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating existing volume attachment record: 238fd49d-c5ea-4ea7-827b-3b06f4870983 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:00:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Successfully created port: cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Successfully updated port: cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-changed-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing instance network info cache due to event network-changed-cd16e6b9-9b55-4348-a850-701d19409382. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] Acquiring lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] Acquired lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing network info cache for port cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:00:32 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=24.267898559570312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 6bff7d80-06e7-4219-a602-6c6be1fef714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 4caf1ff5-2201-454c-a281-858e96175bab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec7bc0c6-c339-49e8-94b9-f0cb87154756 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7b22028b-f825-4f5c-bb33-f6ce7cae0c58 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 83f377d2-5f86-4065-8e9d-ab9beda7f396 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-34262d2a-b7d9-451e-8e8e-2f753b8cad63 req-e60be0f9-0701-4342-861c-40f9d24cb2bc service nova] Releasing lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquired lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:00:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating instance_info_cache with network_info: [{"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Releasing lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance network_info: |[{"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:00:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:00:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Creating image(s)
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Ensure instance console log exists: /opt/stack/data/nova/instances/83f377d2-5f86-4065-8e9d-ab9beda7f396/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Start _get_guest_xml network_info=[{"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '238fd49d-c5ea-4ea7-827b-3b06f4870983', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXbfFgvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83f377d2-5f86-4065-8e9d-ab9beda7f396', 'attached_at': '', 'detached_at': '', 'volume_id': '6a8a89ca-fffe-4285-87f9-487e843a5132', 'serial': '6a8a89ca-fffe-4285-87f9-487e843a5132'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:00:35 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:00:35 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXbfFgvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:35 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:35 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:35 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c150051-0a94-4e7a-bd39-b54fa4958694]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:00:35 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2137f27c-5b00-489f-a5dc-83bec3d546e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132] added
Nov 15 16:00:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5f4d4-20ff-42d3-af3c-4789f4961682]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf00a9-0e33-418c-bc2f-c7cdc1feb38f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXbfFgvr {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXbfFgvr" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f2cf7e-03f0-47df-a0c1-9cddce784003]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXbfFgvr'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[710ad50e-2bc3-40f4-a0d4-f26a70f6db57]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f4266f-b850-4b25-9908-fb3da3e4db90]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:35 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cf6add-c472-4fc5-854c-c9a66e0f8c64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260]
Nov 15 16:00:36 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260] successful.
Nov 15 16:00:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff0bec-0cc6-4ff6-b4dd-1c30a2d43a72]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8df62-d0c1-4f7d-874a-f43ee9211e40]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:36 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:36 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbeb59a-ce2d-44b9-95ff-f9eefe69e93b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:00:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXbfFgvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23265646266326363', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265646266326363', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332625469',display_name='tempest-TestVolumeBootPattern-server-1332625469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332625469',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-rdc98ip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:00:30Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=83f377d2-5f86-4065-8e9d-ab9beda7f396,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'pci_devices' on Instance uuid 83f377d2-5f86-4065-8e9d-ab9beda7f396 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:00:37 user nova-compute[75095]:   <uuid>83f377d2-5f86-4065-8e9d-ab9beda7f396</uuid>
Nov 15 16:00:37 user nova-compute[75095]:   <name>instance-00000028</name>
Nov 15 16:00:37 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:00:37 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:00:37 user nova-compute[75095]:   <metadata>
Nov 15 16:00:37 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:00:37 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:00:37 user nova-compute[75095]:       <nova:name>tempest-TestVolumeBootPattern-server-1332625469</nova:name>
Nov 15 16:00:37 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:00:35</nova:creationTime>
Nov 15 16:00:37 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:00:37 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:00:37 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:00:37 user nova-compute[75095]:       <nova:owner>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:user uuid="f02f7b31bee84b1790581da3ffa3c249">tempest-TestVolumeBootPattern-2108978395-project-member</nova:user>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:project uuid="411ae82aac4242d6a14fd6625204b8fd">tempest-TestVolumeBootPattern-2108978395</nova:project>
Nov 15 16:00:37 user nova-compute[75095]:       </nova:owner>
Nov 15 16:00:37 user nova-compute[75095]:       <nova:ports>
Nov 15 16:00:37 user nova-compute[75095]:         <nova:port uuid="cd16e6b9-9b55-4348-a850-701d19409382">
Nov 15 16:00:37 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 16:00:37 user nova-compute[75095]:         </nova:port>
Nov 15 16:00:37 user nova-compute[75095]:       </nova:ports>
Nov 15 16:00:37 user nova-compute[75095]:     </nova:instance>
Nov 15 16:00:37 user nova-compute[75095]:   </metadata>
Nov 15 16:00:37 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:00:37 user nova-compute[75095]:     <system>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="serial">83f377d2-5f86-4065-8e9d-ab9beda7f396</entry>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="uuid">83f377d2-5f86-4065-8e9d-ab9beda7f396</entry>
Nov 15 16:00:37 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:00:37 user nova-compute[75095]:     </system>
Nov 15 16:00:37 user nova-compute[75095]:   </sysinfo>
Nov 15 16:00:37 user nova-compute[75095]:   <os>
Nov 15 16:00:37 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:00:37 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:00:37 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:00:37 user nova-compute[75095]:   </os>
Nov 15 16:00:37 user nova-compute[75095]:   <features>
Nov 15 16:00:37 user nova-compute[75095]:     <acpi/>
Nov 15 16:00:37 user nova-compute[75095]:     <apic/>
Nov 15 16:00:37 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:00:37 user nova-compute[75095]:   </features>
Nov 15 16:00:37 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:00:37 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:00:37 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:00:37 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:00:37 user nova-compute[75095]:   </clock>
Nov 15 16:00:37 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:00:37 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:00:37 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:00:37 user nova-compute[75095]:   </cpu>
Nov 15 16:00:37 user nova-compute[75095]:   <devices>
Nov 15 16:00:37 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:00:37 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:00:37 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 16:00:37 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:00:37 user nova-compute[75095]:       <serial>6a8a89ca-fffe-4285-87f9-487e843a5132</serial>
Nov 15 16:00:37 user nova-compute[75095]:     </disk>
Nov 15 16:00:37 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:00:37 user nova-compute[75095]:       <mac address="fa:16:3e:cf:c9:1e"/>
Nov 15 16:00:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:00:37 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:00:37 user nova-compute[75095]:       <target dev="tapcd16e6b9-9b"/>
Nov 15 16:00:37 user nova-compute[75095]:     </interface>
Nov 15 16:00:37 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:00:37 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/83f377d2-5f86-4065-8e9d-ab9beda7f396/console.log" append="off"/>
Nov 15 16:00:37 user nova-compute[75095]:     </serial>
Nov 15 16:00:37 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:00:37 user nova-compute[75095]:     <video>
Nov 15 16:00:37 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:00:37 user nova-compute[75095]:     </video>
Nov 15 16:00:37 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:00:37 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:00:37 user nova-compute[75095]:     </rng>
Nov 15 16:00:37 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:00:37 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:00:37 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:00:37 user nova-compute[75095]:     </memballoon>
Nov 15 16:00:37 user nova-compute[75095]:   </devices>
Nov 15 16:00:37 user nova-compute[75095]: </domain>
Nov 15 16:00:37 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332625469',display_name='tempest-TestVolumeBootPattern-server-1332625469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332625469',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-rdc98ip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:00:30Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=83f377d2-5f86-4065-8e9d-ab9beda7f396,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG os_vif [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44e7813a-e6bc-55a2-b3ab-a3f9cb68b0f9', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcd16e6b9-9b, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcd16e6b9-9b, col_values=(('qos', UUID('7bab1600-cc86-4acf-aa7a-32555d4ba311')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcd16e6b9-9b, col_values=(('external_ids', {'iface-id': 'cd16e6b9-9b55-4348-a850-701d19409382', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:c9:1e', 'vm-uuid': '83f377d2-5f86-4065-8e9d-ab9beda7f396'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:37 user nova-compute[75095]: INFO os_vif [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b')
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:00:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] No VIF found with MAC fa:16:3e:cf:c9:1e, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] No waiting events found dispatching network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:38 user nova-compute[75095]: WARNING nova.compute.manager [req-ca5cc455-36d9-48cf-976d-38bde56112d7 req-2f671358-536b-4625-9310-4af22b3a8c9a service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received unexpected event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 for instance with vm_state building and task_state spawning.
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:00:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance spawned successfully.
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:00:40 user nova-compute[75095]: INFO nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] No waiting events found dispatching network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:40 user nova-compute[75095]: WARNING nova.compute.manager [req-b3e41396-46fa-452b-beb2-05e93d05d6b9 req-8fdd61b7-e4e3-479f-94f5-ab58d006010d service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received unexpected event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 for instance with vm_state building and task_state spawning.
Nov 15 16:00:40 user nova-compute[75095]: INFO nova.compute.manager [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Took 11.03 seconds to build instance.
Nov 15 16:00:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e613fe79-3368-4c8e-a755-14141b2525cf tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.154s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-changed-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing instance network info cache due to event network-changed-d03bebad-135e-434e-a97c-6f28c62d3e86. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] Acquiring lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] Acquired lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Refreshing network info cache for port d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updated VIF entry in instance network info cache for port d03bebad-135e-434e-a97c-6f28c62d3e86. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [{"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04414912-fe31-4995-8d32-cea8636d798f req-5fbb10d4-6798-4ca1-b299-4ddee6af68f1 service nova] Releasing lock "refresh_cache-7b22028b-f825-4f5c-bb33-f6ce7cae0c58" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:00:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:48 user nova-compute[75095]: INFO nova.compute.manager [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Terminating instance
Nov 15 16:00:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-68e9e78e-12b9-4ccc-9d4f-6a35b342f1b5 req-3cc2161f-c17e-4093-a22b-edaaad886986 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-d03bebad-135e-434e-a97c-6f28c62d3e86 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b0f541d-0cb0-4aef-bd2a-9184731c0c21 req-c8e9fd89-608f-4960-a212-956f458a1a9f service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-21769566-20c9-427e-8e66-6a7eb344cae0 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-df055730-b577-4dc3-8055-f45fcf2fb3fe req-2f54f4b6-c852-450d-ab02-5a6226706d9d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Instance destroyed successfully.
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lazy-loading 'resources' on Instance uuid 7b22028b-f825-4f5c-bb33-f6ce7cae0c58 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d03bebad-135e-434e-a97c-6f28c62d3e86", "address": "fa:16:3e:6d:55:39", "network": {"id": "bb803303-0a47-4cd7-a89e-7722f95f564c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-167406778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd03bebad-13", "ovs_interfaceid": "d03bebad-135e-434e-a97c-6f28c62d3e86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd03bebad-13, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e982a8d1-209f-4540-87c3-6c83e8cdd80e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:55:39,bridge_name='br-int',has_traffic_filtering=True,id=d03bebad-135e-434e-a97c-6f28c62d3e86,network=Network(bb803303-0a47-4cd7-a89e-7722f95f564c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd03bebad-13')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2e18ee6-16, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de4ee6bb-be0d-4297-992e-ef7b54f994ca) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:16:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2e18ee6-1682-4e10-9749-8287299df4a8,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2e18ee6-16')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21769566-20, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a556ccd9-dec4-4e71-a8c0-d344dda7674d) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:58:91,bridge_name='br-int',has_traffic_filtering=True,id=21769566-20c9-427e-8e66-6a7eb344cae0,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap21769566-20')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e867c8-e2, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef31331f-7b09-4e6c-bfc2-4ff1674f9f45) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:51:9c,bridge_name='br-int',has_traffic_filtering=True,id=26e867c8-e236-40ec-b4e1-b062ab6d7032,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26e867c8-e2')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap585238c9-9e, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1118d64-b9ba-43a5-917e-33755c07c35c) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:c6:d1,bridge_name='br-int',has_traffic_filtering=True,id=585238c9-9efd-4aa2-8d36-0d39ac9c8f5a,network=Network(77219edb-21be-4770-8a10-e874a6223db9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap585238c9-9e')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8aaade1-4b, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7a5387a-bc96-4b15-a634-35771a31c324) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:0e:93,bridge_name='br-int',has_traffic_filtering=True,id=d8aaade1-4bfb-4720-9aed-57f27ffd264d,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8aaade1-4b')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T15:58:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-835567113',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-835567113',id=38,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzS6aG/e8aZtI7wp5ms3C2LVsLJwRYbW3EKf+ElWkgBIyNCRf/NxEAsTTlIT6Xi719kdnCCBxeGRDVTK4GSmM/bbj3C+cTQuNyP3MRMgzP05ilBieuIY3T+sXMc6aaSRA==',key_name='tempest-keypair-1760238218',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3febf29b62f048d587c6a2b53ab24795',ramdisk_id='',reservation_id='r-0l31us6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-731424877',owner_user_name='tempest-TaggedBootDevicesTest-731424877-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a7525313ce3491e8e5b45ca9abfefff',uuid=7b22028b-f825-4f5c-bb33-f6ce7cae0c58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converting VIF {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cae3321-a2, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=161e0be2-2a5b-4d69-9c6d-4e9442121ab1) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:50 user nova-compute[75095]: INFO os_vif [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f7:eb,bridge_name='br-int',has_traffic_filtering=True,id=7cae3321-a206-46cc-8f3e-39ebf418580b,network=Network(87a39edc-1415-4e39-a5f4-00a33d1f23c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cae3321-a2')
Nov 15 16:00:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EGirQkdA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:50 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b364436-2e1b-4b1a-99bd-f4e1d32e449e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:00:50 user nova-compute[75095]: No targets found.
Nov 15 16:00:50 user nova-compute[75095]: iSNS:
Nov 15 16:00:50 user nova-compute[75095]: No targets found.
Nov 15 16:00:50 user nova-compute[75095]: STATIC:
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:00:50 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:50 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:50 user nova-compute[75095]: FIRMWARE:
Nov 15 16:00:50 user nova-compute[75095]: No targets found.
Nov 15 16:00:50 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:00:50 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:00:50 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[771eb3bb-4aa4-4b7e-bcae-42e6d555c5d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a00312-d1e8-404f-9a13-21aeca921d16]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:50 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:50 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c216950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:00:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0097d6-1a2b-4b0c-8840-1d9c89a94a74]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0aae739-7425-4c70-a297-3e71a2413fec]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[252cd404-a00c-4c5b-a27f-91bcd0bf5a3a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b75a01-5cfc-46af-8d9f-23d5af781272]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d03bebad-135e-434e-a97c-6f28c62d3e86 for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-f2e18ee6-1682-4e10-9749-8287299df4a8 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-f2e18ee6-1682-4e10-9749-8287299df4a8 for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-b1d84173-e396-4491-a525-d99fcb516c10 req-80687fa6-a0b7-4c3d-bbd7-d01863f69ebd service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-d8aaade1-4bfb-4720-9aed-57f27ffd264d for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94eaa1-54c4-4dd8-8f63-036f97e43df8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c3c927-3a0d-4263-8acf-a2f8244242c7]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260]
Nov 15 16:00:51 user nova-compute[75095]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145, portal: 172.16.0.220,3260] successful.
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f6567b-8ee2-48aa-ba5f-c645b0ca9145 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f456716a-9c8a-4bf9-9627-37f84a9178e3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== disconnect_volume: return (315ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hCaxOSHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed43ceb-a791-4e73-962e-a5b812bd31bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]: iSNS:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]: STATIC:
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: FIRMWARE:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:00:51 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:00:51 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-21769566-20c9-427e-8e66-6a7eb344cae0 for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-63534587-aab0-4b13-aa5d-62f5196a7e73 req-32fc2bce-6f0f-465b-a5a7-38ccdfbf292d service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-26e867c8-e236-40ec-b4e1-b062ab6d7032 for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[996aadbb-ea6b-4c73-87a3-db025510fb29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6596d-f239-4b3f-86b9-f4aeba2975be]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c232050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5'): ({'sdg'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Removing single pathed devices sdg {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5ffe1-b8f6-4b45-aaa8-2dd8a50234d6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667910d-440b-4099-9e00-b5cc799e13b0]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Flushing IO for device /dev/sdg {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5a20f1-1b71-454b-9247-6c7ecadd4ee7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2a6c26-7d6c-4475-8b3b-818084eb1938]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] SCSI volumes sdg have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[476e285f-a4ed-4142-bbaf-82817d1f4f14]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8917e177-8e21-4961-bb0c-b8cde076c47b]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260]
Nov 15 16:00:51 user nova-compute[75095]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5, portal: 172.16.0.220,3260] successful.
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f840484-b956-4597-8011-11efa95fa7e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84300f03-2004-4d5f-a113-d34f149db287]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== disconnect_volume: return (326ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ktDVzLga', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaba5bf-01b1-4624-b706-1fe1a4754eff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]: iSNS:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]: STATIC:
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:00:51 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:00:51 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:00:51 user nova-compute[75095]: FIRMWARE:
Nov 15 16:00:51 user nova-compute[75095]: No targets found.
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:00:51 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:00:51 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c335ee2-e921-4303-ab0f-d0f4fe9e186a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-unplugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-unplugged-7cae3321-a206-46cc-8f3e-39ebf418580b for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Acquiring lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] No waiting events found dispatching network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:00:51 user nova-compute[75095]: WARNING nova.compute.manager [req-eaef2250-553c-4d5e-a5d3-f0839b800454 req-ef6ab4ab-fffa-4cad-8955-f7879184dee4 service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received unexpected event network-vif-plugged-7cae3321-a206-46cc-8f3e-39ebf418580b for instance with vm_state active and task_state deleting.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c347543-b035-4615-9317-e1d3f589ff3b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa (non-flash)
Nov 15 16:00:51 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c358ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa'): ({'sdh'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Removing single pathed devices sdh {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f69944-a870-4072-a81b-7e55c84b1e70]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c550328-148a-4bf5-a031-720438b4c6e9]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Flushing IO for device /dev/sdh {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a340cf57-bb6e-4c97-8625-6accc16aec5b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9258db33-dada-47f3-ae6a-79a020775f56]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] SCSI volumes sdh have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a9f4e0-543b-4f5c-ae39-3f21592b64d8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef16bfac-f1b6-4536-95b1-7cbc61fdbca2]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260]
Nov 15 16:00:51 user nova-compute[75095]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa, portal: 172.16.0.220,3260] successful.
Nov 15 16:00:51 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:403e83a5-a791-4e70-a32f-d1e93b1802aa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ba3dc6-315e-4947-b748-fa5a8f42a40d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] <== disconnect_volume: return (314ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:00:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Deleting instance files /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58_del
Nov 15 16:00:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Deletion of /opt/stack/data/nova/instances/7b22028b-f825-4f5c-bb33-f6ce7cae0c58_del complete
Nov 15 16:00:51 user nova-compute[75095]: INFO nova.compute.manager [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Took 3.25 seconds to destroy the instance on the hypervisor.
Nov 15 16:00:51 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:00:51 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:00:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-f61cf5fe-3fac-4cc8-ad57-653a6f31e3ae req-2dbdfd43-b49b-4549-94ce-3ab99affb7da service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-deleted-d03bebad-135e-434e-a97c-6f28c62d3e86 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:53 user nova-compute[75095]: INFO nova.compute.manager [req-f61cf5fe-3fac-4cc8-ad57-653a6f31e3ae req-2dbdfd43-b49b-4549-94ce-3ab99affb7da service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Neutron deleted interface d03bebad-135e-434e-a97c-6f28c62d3e86; detaching it from the instance and deleting it from the info cache
Nov 15 16:00:53 user nova-compute[75095]: DEBUG nova.network.neutron [req-f61cf5fe-3fac-4cc8-ad57-653a6f31e3ae req-2dbdfd43-b49b-4549-94ce-3ab99affb7da service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [{"id": "f2e18ee6-1682-4e10-9749-8287299df4a8", "address": "fa:16:3e:ed:16:f8", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2e18ee6-16", "ovs_interfaceid": "f2e18ee6-1682-4e10-9749-8287299df4a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "21769566-20c9-427e-8e66-6a7eb344cae0", "address": "fa:16:3e:65:58:91", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21769566-20", "ovs_interfaceid": "21769566-20c9-427e-8e66-6a7eb344cae0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "address": "fa:16:3e:e6:51:9c", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e867c8-e2", "ovs_interfaceid": "26e867c8-e236-40ec-b4e1-b062ab6d7032", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "address": "fa:16:3e:89:c6:d1", "network": {"id": "77219edb-21be-4770-8a10-e874a6223db9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1987827083", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap585238c9-9e", "ovs_interfaceid": "585238c9-9efd-4aa2-8d36-0d39ac9c8f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "address": "fa:16:3e:d1:0e:93", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8aaade1-4b", "ovs_interfaceid": "d8aaade1-4bfb-4720-9aed-57f27ffd264d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7cae3321-a206-46cc-8f3e-39ebf418580b", "address": "fa:16:3e:ce:f7:eb", "network": {"id": "87a39edc-1415-4e39-a5f4-00a33d1f23c0", "bridge": "br-int", "label": "tempest-device-tagging-net2-175525325", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3febf29b62f048d587c6a2b53ab24795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cae3321-a2", "ovs_interfaceid": "7cae3321-a206-46cc-8f3e-39ebf418580b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-f61cf5fe-3fac-4cc8-ad57-653a6f31e3ae req-2dbdfd43-b49b-4549-94ce-3ab99affb7da service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Detach interface failed, port_id=d03bebad-135e-434e-a97c-6f28c62d3e86, reason: Instance 7b22028b-f825-4f5c-bb33-f6ce7cae0c58 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:00:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:54 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:54 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Took 2.87 seconds to deallocate network for instance.
Nov 15 16:00:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-21331752-e6e1-41d0-b775-97450df4e300 req-0ebc501c-1c6a-40ac-a4bf-376d0df659ab service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-deleted-585238c9-9efd-4aa2-8d36-0d39ac9c8f5a {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-21331752-e6e1-41d0-b775-97450df4e300 req-0ebc501c-1c6a-40ac-a4bf-376d0df659ab service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-deleted-7cae3321-a206-46cc-8f3e-39ebf418580b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-21331752-e6e1-41d0-b775-97450df4e300 req-0ebc501c-1c6a-40ac-a4bf-376d0df659ab service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-deleted-d8aaade1-4bfb-4720-9aed-57f27ffd264d {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-21331752-e6e1-41d0-b775-97450df4e300 req-0ebc501c-1c6a-40ac-a4bf-376d0df659ab service nova] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Received event network-vif-deleted-26e867c8-e236-40ec-b4e1-b062ab6d7032 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:00:56 user nova-compute[75095]: INFO nova.compute.manager [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] [instance: 7b22028b-f825-4f5c-bb33-f6ce7cae0c58] Took 2.09 seconds to detach 3 volumes for instance.
Nov 15 16:00:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:57 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:00:57 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:00:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:57 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Deleted allocations for instance 7b22028b-f825-4f5c-bb33-f6ce7cae0c58
Nov 15 16:00:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-af50ca57-b008-4c82-9814-b9c976bcdbd9 tempest-TaggedBootDevicesTest-731424877 tempest-TaggedBootDevicesTest-731424877-project-member] Lock "7b22028b-f825-4f5c-bb33-f6ce7cae0c58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.769s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing instance network info cache due to event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'flavor' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:00:58 user nova-compute[75095]: INFO nova.compute.manager [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Attaching volume 43fbd59c-0852-4df0-8451-2048e302b677 to /dev/vdb
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.utils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71ec881-00fb-46b7-a58d-d91752317b32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f3cba-b03c-4be9-bb89-08b654a8e82b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abccfaa-0ef3-42b3-a6a8-75fca3f949b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee18427c-a714-437b-ac77-c024989f70c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updated VIF entry in instance network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:00:58 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bd7de-6156-41d1-b68d-295d3d34214c]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG os_brick.utils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating existing volume attachment record: f76068cb-8791-491b-9d0e-b3e366bb7b65 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:00:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-df6b4343-7618-438e-8f05-84ab5af069dd req-05a8a32d-2bea-4d78-b1aa-8bf8967e9bac service nova] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:00:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHeglCpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:01:03 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:01:03 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:01:03 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf49c76f-608d-42a5-8ce3-24932d79cf94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:01:03 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[602926a1-ef54-46b2-b435-aa527b0b2643]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677] added
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[367c9cb4-6f5c-4f11-96a6-9c4091a7fb88]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6834687-c62c-427a-9bff-6c6ecaffed5f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHeglCpW {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHeglCpW" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eac662c-bd8d-49de-b7b3-3400b4e7e4f6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHeglCpW'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5f1d9b-f129-4ec8-8ae5-16036b50292f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69e52e-c51d-4b7f-ad02-0bfda04cc6b0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2e39c7-60bc-4b72-99e0-95392a63ad0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260]
Nov 15 16:01:03 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260] successful.
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c949d4e-6b37-41cd-b7f8-5931d87c5ec3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4b694-23d0-4aaa-9d3c-f40a6d7eea8f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:01:03 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fa50b2-b8f9-4cf3-8568-68310077f0e6]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:01:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHeglCpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23732353935633535', 'path': '/dev/sde'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732353935633535', 'path': '/dev/sde'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG nova.objects.instance [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'flavor' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:01:04 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:01:04 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 16:01:04 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:01:04 user nova-compute[75095]:   <serial>43fbd59c-0852-4df0-8451-2048e302b677</serial>
Nov 15 16:01:04 user nova-compute[75095]: </disk>
Nov 15 16:01:04 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:01:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:01:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:01:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:62:b4:08, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:01:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-2d38597b-4839-42b1-b291-abb31fe16eea tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.724s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:06 user nova-compute[75095]: INFO nova.compute.manager [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Rescuing
Nov 15 16:01:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:07 user nova-compute[75095]: WARNING nova.compute.manager [req-20bfae46-a2e1-4a61-8e1f-79314c13399a req-c4660615-3ef3-4db2-845f-1663d7538217 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state rescuing.
Nov 15 16:01:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance destroyed successfully.
Nov 15 16:01:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Attempting rescue
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75095) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance directory exists: not creating {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 16:01:07 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Creating image(s)
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue" returned: 0 in 0.058s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'migration_context' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.base [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<2fac940f-34d2-401e-ad63-b60436b81807> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start _get_guest_xml network_info=[{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:62:b4:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.base [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<2fac940f-34d2-401e-ad63-b60436b81807> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.base [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<2fac940f-34d2-401e-ad63-b60436b81807> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:01:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:01:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.base [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<2fac940f-34d2-401e-ad63-b60436b81807> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361455939',display_name='tempest-ServerRescueNegativeTestJSON-server-1361455939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361455939',id=39,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH16vexSVhF620msGDtWMag6BC8oQ3f6Ef/hJMnQ2BpKkMsdp37K7Dy9QN5mmlZ2H1yxg444oTk17ObM4mDUGwSA+whErFBkOYOWejIcffMyo3PzJ4Irx4OONjwrcDgUrw==',key_name='tempest-keypair-1716535491',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-dpa0cmvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T15:59:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b373d886288b4895a2b41b26063db3fa',uuid=2fac940f-34d2-401e-ad63-b60436b81807,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:62:b4:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "vif_mac": "fa:16:3e:62:b4:08"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.objects.base [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Object Instance<2fac940f-34d2-401e-ad63-b60436b81807> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:01:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:01:07 user nova-compute[75095]:   <uuid>2fac940f-34d2-401e-ad63-b60436b81807</uuid>
Nov 15 16:01:07 user nova-compute[75095]:   <name>instance-00000027</name>
Nov 15 16:01:07 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:01:07 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:01:07 user nova-compute[75095]:   <metadata>
Nov 15 16:01:07 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:01:07 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1361455939</nova:name>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:01:07</nova:creationTime>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:01:07 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:01:07 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:owner>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:user uuid="b373d886288b4895a2b41b26063db3fa">tempest-ServerRescueNegativeTestJSON-1926967793-project-member</nova:user>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:project uuid="a0cf29264b1f4e38982c483eed3bf857">tempest-ServerRescueNegativeTestJSON-1926967793</nova:project>
Nov 15 16:01:07 user nova-compute[75095]:       </nova:owner>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:01:07 user nova-compute[75095]:       <nova:ports>
Nov 15 16:01:07 user nova-compute[75095]:         <nova:port uuid="85c7b24d-5d78-4a1a-904c-002d4a0276aa">
Nov 15 16:01:07 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 16:01:07 user nova-compute[75095]:         </nova:port>
Nov 15 16:01:07 user nova-compute[75095]:       </nova:ports>
Nov 15 16:01:07 user nova-compute[75095]:     </nova:instance>
Nov 15 16:01:07 user nova-compute[75095]:   </metadata>
Nov 15 16:01:07 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:01:07 user nova-compute[75095]:     <system>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="serial">2fac940f-34d2-401e-ad63-b60436b81807</entry>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="uuid">2fac940f-34d2-401e-ad63-b60436b81807</entry>
Nov 15 16:01:07 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:01:07 user nova-compute[75095]:     </system>
Nov 15 16:01:07 user nova-compute[75095]:   </sysinfo>
Nov 15 16:01:07 user nova-compute[75095]:   <os>
Nov 15 16:01:07 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:01:07 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:01:07 user nova-compute[75095]:   </os>
Nov 15 16:01:07 user nova-compute[75095]:   <features>
Nov 15 16:01:07 user nova-compute[75095]:     <acpi/>
Nov 15 16:01:07 user nova-compute[75095]:     <apic/>
Nov 15 16:01:07 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:01:07 user nova-compute[75095]:   </features>
Nov 15 16:01:07 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:01:07 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:01:07 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:01:07 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:01:07 user nova-compute[75095]:   </clock>
Nov 15 16:01:07 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:01:07 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:01:07 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:01:07 user nova-compute[75095]:   </cpu>
Nov 15 16:01:07 user nova-compute[75095]:   <devices>
Nov 15 16:01:07 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:01:07 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:01:07 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue"/>
Nov 15 16:01:07 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:01:07 user nova-compute[75095]:     </disk>
Nov 15 16:01:07 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:01:07 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:01:07 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk"/>
Nov 15 16:01:07 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 16:01:07 user nova-compute[75095]:     </disk>
Nov 15 16:01:07 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:01:07 user nova-compute[75095]:       <mac address="fa:16:3e:62:b4:08"/>
Nov 15 16:01:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:01:07 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:01:07 user nova-compute[75095]:       <target dev="tap85c7b24d-5d"/>
Nov 15 16:01:07 user nova-compute[75095]:     </interface>
Nov 15 16:01:07 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:01:07 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/console.log" append="off"/>
Nov 15 16:01:07 user nova-compute[75095]:     </serial>
Nov 15 16:01:07 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:01:07 user nova-compute[75095]:     <video>
Nov 15 16:01:07 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:01:07 user nova-compute[75095]:     </video>
Nov 15 16:01:07 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:01:07 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:01:07 user nova-compute[75095]:     </rng>
Nov 15 16:01:07 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:01:07 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:01:07 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:01:07 user nova-compute[75095]:     </memballoon>
Nov 15 16:01:07 user nova-compute[75095]:   </devices>
Nov 15 16:01:07 user nova-compute[75095]: </domain>
Nov 15 16:01:07 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:01:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance destroyed successfully.
Nov 15 16:01:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:01:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:01:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] No VIF found with MAC fa:16:3e:62:b4:08, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:09 user nova-compute[75095]: WARNING nova.compute.manager [req-c273f9a3-5679-406f-8cd0-2160acc6e98d req-86dc9972-1dce-4da6-bd22-130422844a9a service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state rescuing.
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:11 user nova-compute[75095]: WARNING nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state rescuing.
Nov 15 16:01:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:11 user nova-compute[75095]: DEBUG nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:11 user nova-compute[75095]: WARNING nova.compute.manager [req-410650eb-9571-45a2-ab73-c577565b1d98 req-9a0ffb0e-af82-4c05-9dc1-6db770ebbda4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state rescuing.
Nov 15 16:01:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7768882e-6aff-4739-b5e9-4c1460eb31f4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:14 user nova-compute[75095]: INFO nova.compute.manager [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Terminating instance
Nov 15 16:01:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-unplugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] No waiting events found dispatching network-vif-unplugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-7ed17112-8719-40cd-824d-8df13e1440d4 req-7b2dd652-e52a-48a5-9955-c601c75d504f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-unplugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:01:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Instance destroyed successfully.
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lazy-loading 'resources' on Instance uuid 6bff7d80-06e7-4219-a602-6c6be1fef714 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:42:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1684390480',display_name='tempest-ServerActionsTestOtherA-server-1684390480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1684390480',id=3,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOK3PAivNlUMi7++TK27m1OeprwtKQmKYyIKwIKQbL9dyFfwu3BaSBO+So5Pc0i8GBVMhwbgAcaEes2qfIhIsv+HRguR7auBQKe5xcJqEFvB4eO11D5dHXsRj0bOoQHzA==',key_name='tempest-keypair-445240852',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='18c587b1467441ceb091ece4e973408e',ramdisk_id='',reservation_id='r-x08ajgqz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-440053215',owner_user_name='tempest-ServerActionsTestOtherA-440053215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:42:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='975ca4994eb74b6bbf541bb308b148f1',uuid=6bff7d80-06e7-4219-a602-6c6be1fef714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converting VIF {"id": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "address": "fa:16:3e:77:e0:f7", "network": {"id": "d1f6de08-aee1-4418-9f8f-c41e14c74b1c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-825000405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "18c587b1467441ceb091ece4e973408e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be16d0d-57", "ovs_interfaceid": "7be16d0d-57a4-4ee4-922b-e4837f781f65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG os_vif [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be16d0d-57, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=148acfab-99ec-4a2b-9ad0-39728427158c) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:15 user nova-compute[75095]: INFO os_vif [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e0:f7,bridge_name='br-int',has_traffic_filtering=True,id=7be16d0d-57a4-4ee4-922b-e4837f781f65,network=Network(d1f6de08-aee1-4418-9f8f-c41e14c74b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be16d0d-57')
Nov 15 16:01:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Deleting instance files /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714_del
Nov 15 16:01:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Deletion of /opt/stack/data/nova/instances/6bff7d80-06e7-4219-a602-6c6be1fef714_del complete
Nov 15 16:01:15 user nova-compute[75095]: INFO nova.compute.manager [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 16:01:15 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:01:15 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Took 0.44 seconds to deallocate network for instance.
Nov 15 16:01:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-66d2e149-d61c-4955-a082-cb34a2968adb req-4d326c89-0b67-407f-bbf4-2fe4253b0082 service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-deleted-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:16 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Deleted allocations for instance 6bff7d80-06e7-4219-a602-6c6be1fef714
Nov 15 16:01:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9211a4f8-a32c-4044-b9e1-ace006fce9d2 tempest-ServerActionsTestOtherA-440053215 tempest-ServerActionsTestOtherA-440053215-project-member] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.651s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:01:16 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] Acquiring lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] Lock "6bff7d80-06e7-4219-a602-6c6be1fef714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] No waiting events found dispatching network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:17 user nova-compute[75095]: WARNING nova.compute.manager [req-37f568c6-0a7d-424e-92ff-6f1f684e95c8 req-252706ea-e455-49a9-bae4-1eea5f52235f service nova] [instance: 6bff7d80-06e7-4219-a602-6c6be1fef714] Received unexpected event network-vif-plugged-7be16d0d-57a4-4ee4-922b-e4837f781f65 for instance with vm_state deleted and task_state None.
Nov 15 16:01:17 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [{"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8590b8bb-61ea-4e65-826e-c8e0caf4620e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:01:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:01:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:25 user nova-compute[75095]: INFO nova.compute.manager [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Unrescuing
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquired lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:01:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating instance_info_cache with network_info: [{"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Releasing lock "refresh_cache-4caf1ff5-2201-454c-a281-858e96175bab" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'flavor' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:26 user nova-compute[75095]: WARNING nova.compute.manager [req-e0540042-54e1-4b48-850c-4ec2a02bc865 req-2f1fde8a-d724-4e00-8da1-5b7042d5beb1 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state rescued and task_state unrescuing.
Nov 15 16:01:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance destroyed successfully.
Nov 15 16:01:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:28 user nova-compute[75095]: WARNING nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state rescued and task_state unrescuing.
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:28 user nova-compute[75095]: WARNING nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state rescued and task_state unrescuing.
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:01:28 user nova-compute[75095]: WARNING nova.compute.manager [req-d2a8d5f0-430a-46a3-979b-7a0bea56fe7d req-e16779ea-5c12-46cb-b7fc-0a845ddb0a03 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state rescued and task_state unrescuing.
Nov 15 16:01:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d430a213-414e-4144-9a1c-766e02e40b5b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:01:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:01:33 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:01:33 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8044MB free_disk=24.285003662109375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 4caf1ff5-2201-454c-a281-858e96175bab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec7bc0c6-c339-49e8-94b9-f0cb87154756 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 83f377d2-5f86-4065-8e9d-ab9beda7f396 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:01:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:01:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:01:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:04 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:02:04 user nova-compute[75095]: INFO nova.compute.claims [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Claim successful on node user
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:02:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.policy [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bac844ae1f345e79e89acb0cfc8c4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d11880351b4cb6b30085b160c4a460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:02:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Creating image(s)
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk 1073741824" returned: 0 in 0.123s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.311s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:05 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Successfully created port: c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.197s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Cannot resize image /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Ensure instance console log exists: /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Successfully updated port: c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing instance network info cache due to event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.neutron [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance network_info: |[{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start _get_guest_xml network_info=[{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:02:06 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:02:06 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHBDJGYyfD1DBITBa/Hh25RKCW5SlVvxFT8lI0nijgCo3VtMKc27yI9I8JHX2lMtaWryHGhH51kQzW33mWQv+MwthKqYjYdxFi8GWPsj0s5v0ppEUJZrIfby0OtcGh0fQ==',key_name='tempest-keypair-1521200829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:02:06 user nova-compute[75095]:   <uuid>1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</uuid>
Nov 15 16:02:06 user nova-compute[75095]:   <name>instance-00000029</name>
Nov 15 16:02:06 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:02:06 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:02:06 user nova-compute[75095]:   <metadata>
Nov 15 16:02:06 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:02:06 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-388591464</nova:name>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:02:06</nova:creationTime>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:02:06 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:02:06 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:owner>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:user uuid="8bac844ae1f345e79e89acb0cfc8c4d8">tempest-AttachVolumeShelveTestJSON-1599642998-project-member</nova:user>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:project uuid="61d11880351b4cb6b30085b160c4a460">tempest-AttachVolumeShelveTestJSON-1599642998</nova:project>
Nov 15 16:02:06 user nova-compute[75095]:       </nova:owner>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:02:06 user nova-compute[75095]:       <nova:ports>
Nov 15 16:02:06 user nova-compute[75095]:         <nova:port uuid="c72bac14-43d1-4cc4-beaa-786f2a8e0616">
Nov 15 16:02:06 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 16:02:06 user nova-compute[75095]:         </nova:port>
Nov 15 16:02:06 user nova-compute[75095]:       </nova:ports>
Nov 15 16:02:06 user nova-compute[75095]:     </nova:instance>
Nov 15 16:02:06 user nova-compute[75095]:   </metadata>
Nov 15 16:02:06 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:02:06 user nova-compute[75095]:     <system>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="serial">1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</entry>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="uuid">1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</entry>
Nov 15 16:02:06 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:02:06 user nova-compute[75095]:     </system>
Nov 15 16:02:06 user nova-compute[75095]:   </sysinfo>
Nov 15 16:02:06 user nova-compute[75095]:   <os>
Nov 15 16:02:06 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:02:06 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:02:06 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:02:06 user nova-compute[75095]:   </os>
Nov 15 16:02:06 user nova-compute[75095]:   <features>
Nov 15 16:02:06 user nova-compute[75095]:     <acpi/>
Nov 15 16:02:06 user nova-compute[75095]:     <apic/>
Nov 15 16:02:06 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:02:06 user nova-compute[75095]:   </features>
Nov 15 16:02:06 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:02:06 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:02:06 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:02:06 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:02:06 user nova-compute[75095]:   </clock>
Nov 15 16:02:06 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:02:06 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:02:06 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:02:06 user nova-compute[75095]:   </cpu>
Nov 15 16:02:06 user nova-compute[75095]:   <devices>
Nov 15 16:02:06 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:02:06 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:02:06 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk"/>
Nov 15 16:02:06 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:02:06 user nova-compute[75095]:     </disk>
Nov 15 16:02:06 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:02:06 user nova-compute[75095]:       <mac address="fa:16:3e:c4:a2:2a"/>
Nov 15 16:02:06 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:02:06 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:02:06 user nova-compute[75095]:       <target dev="tapc72bac14-43"/>
Nov 15 16:02:06 user nova-compute[75095]:     </interface>
Nov 15 16:02:06 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:02:06 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/console.log" append="off"/>
Nov 15 16:02:06 user nova-compute[75095]:     </serial>
Nov 15 16:02:06 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:02:06 user nova-compute[75095]:     <video>
Nov 15 16:02:06 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:02:06 user nova-compute[75095]:     </video>
Nov 15 16:02:06 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:02:06 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:02:06 user nova-compute[75095]:     </rng>
Nov 15 16:02:06 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:02:06 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:02:06 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:02:06 user nova-compute[75095]:     </memballoon>
Nov 15 16:02:06 user nova-compute[75095]:   </devices>
Nov 15 16:02:06 user nova-compute[75095]: </domain>
Nov 15 16:02:06 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHBDJGYyfD1DBITBa/Hh25RKCW5SlVvxFT8lI0nijgCo3VtMKc27yI9I8JHX2lMtaWryHGhH51kQzW33mWQv+MwthKqYjYdxFi8GWPsj0s5v0ppEUJZrIfby0OtcGh0fQ==',key_name='tempest-keypair-1521200829',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:02:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG os_vif [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed23f25c-64ac-5bfc-865b-342f1d331f60', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc72bac14-43, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc72bac14-43, col_values=(('qos', UUID('dcc27770-3724-4c06-a163-e64702b00dbd')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc72bac14-43, col_values=(('external_ids', {'iface-id': 'c72bac14-43d1-4cc4-beaa-786f2a8e0616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:a2:2a', 'vm-uuid': '1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:02:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:06 user nova-compute[75095]: INFO os_vif [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43')
Nov 15 16:02:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:02:07 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No VIF found with MAC fa:16:3e:c4:a2:2a, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:02:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updated VIF entry in instance network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:02:07 user nova-compute[75095]: DEBUG nova.network.neutron [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-70889cfb-2dcd-4c56-96f2-c1b63cf2cd6e req-ae8daf21-9e67-4c6e-ab7b-550b2fe7314d service nova] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:02:08 user nova-compute[75095]: WARNING nova.compute.manager [req-c6c158a6-d3e1-4628-8d9b-67e813cc3a1f req-791127cf-bb1a-447e-a380-be2c8056aab6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state building and task_state spawning.
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:02:10 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance spawned successfully.
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:02:10 user nova-compute[75095]: INFO nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:02:10 user nova-compute[75095]: INFO nova.compute.manager [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Took 5.92 seconds to build instance.
Nov 15 16:02:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-87fe83cf-86bc-48de-979a-cde74540578a tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.043s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:02:10 user nova-compute[75095]: WARNING nova.compute.manager [req-0c60b0f0-f3ad-45be-a9e9-ad5b8f7cea0d req-cec1a69c-5af4-46ca-8768-38a3c0ac9a54 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state active and task_state None.
Nov 15 16:02:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-changed-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing instance network info cache due to event network-changed-cd16e6b9-9b55-4348-a850-701d19409382. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] Acquiring lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] Acquired lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.network.neutron [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing network info cache for port cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.network.neutron [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updated VIF entry in instance network info cache for port cd16e6b9-9b55-4348-a850-701d19409382. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.network.neutron [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating instance_info_cache with network_info: [{"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-652cd385-db65-4097-8681-92e35abbf6c5 req-2a7aae3b-ed59-40c2-955d-38d77c3321f5 service nova] Releasing lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:02:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [{"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-82639568-19ea-4e63-a23f-c70ead2b2ca6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-changed-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing instance network info cache due to event network-changed-cd16e6b9-9b55-4348-a850-701d19409382. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] Acquiring lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] Acquired lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Refreshing network info cache for port cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:23 user nova-compute[75095]: INFO nova.compute.manager [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Terminating instance
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Instance destroyed successfully.
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid 83f377d2-5f86-4065-8e9d-ab9beda7f396 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:00:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1332625469',display_name='tempest-TestVolumeBootPattern-server-1332625469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1332625469',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-rdc98ip1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:00:41Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=83f377d2-5f86-4065-8e9d-ab9beda7f396,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_vif [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcd16e6b9-9b, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7bab1600-cc86-4acf-aa7a-32555d4ba311) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:02:23 user nova-compute[75095]: INFO os_vif [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:c9:1e,bridge_name='br-int',has_traffic_filtering=True,id=cd16e6b9-9b55-4348-a850-701d19409382,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcd16e6b9-9b')
Nov 15 16:02:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXbfFgvr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:02:23 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1936eea4-7f10-41d8-bb6f-06e2067259e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:02:23 user nova-compute[75095]: No targets found.
Nov 15 16:02:23 user nova-compute[75095]: iSNS:
Nov 15 16:02:23 user nova-compute[75095]: No targets found.
Nov 15 16:02:23 user nova-compute[75095]: STATIC:
Nov 15 16:02:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:02:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:02:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:02:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:02:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:02:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:02:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:02:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:02:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:02:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132
Nov 15 16:02:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:02:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:02:23 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:02:23 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:02:23 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:02:23 user nova-compute[75095]: FIRMWARE:
Nov 15 16:02:23 user nova-compute[75095]: No targets found.
Nov 15 16:02:23 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:02:23 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:02:23 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:02:23 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b94512-a4dc-461e-ad8c-b48e76aed854]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updated VIF entry in instance network info cache for port cd16e6b9-9b55-4348-a850-701d19409382. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating instance_info_cache with network_info: [{"id": "cd16e6b9-9b55-4348-a850-701d19409382", "address": "fa:16:3e:cf:c9:1e", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcd16e6b9-9b", "ovs_interfaceid": "cd16e6b9-9b55-4348-a850-701d19409382", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[164ac3d5-7bfa-4193-8d24-be69a0506676]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:02:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c66a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-60d852d5-0e5a-4b7f-91e0-67f530d007b0 req-584cb9b0-329f-4792-8655-180fb9cf2270 service nova] Releasing lock "refresh_cache-83f377d2-5f86-4065-8e9d-ab9beda7f396" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43fd21-924a-470e-b7f1-6b75d5e432df]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abcab5e-36bf-4503-88ed-8ba49348d082]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[264eeb33-7043-4ea9-a337-f24299c30ebc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03f5e63-36ab-4a93-8f11-85efe71caf86]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9271c41a-5a8f-451b-bc3f-98b92807b00b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ef35d-1cf7-4858-b20c-0761d3593116]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260]
Nov 15 16:02:24 user nova-compute[75095]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132, portal: 172.16.0.220,3260] successful.
Nov 15 16:02:24 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a8a89ca-fffe-4285-87f9-487e843a5132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6ff3f0-346c-46c7-a12d-596f8fa4c0db]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (344ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:02:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Deleting instance files /opt/stack/data/nova/instances/83f377d2-5f86-4065-8e9d-ab9beda7f396_del
Nov 15 16:02:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Deletion of /opt/stack/data/nova/instances/83f377d2-5f86-4065-8e9d-ab9beda7f396_del complete
Nov 15 16:02:24 user nova-compute[75095]: INFO nova.compute.manager [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 16:02:24 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:02:24 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:24 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Took 0.41 seconds to deallocate network for instance.
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-unplugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] No waiting events found dispatching network-vif-unplugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-unplugged-cd16e6b9-9b55-4348-a850-701d19409382 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Acquiring lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] No waiting events found dispatching network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:02:25 user nova-compute[75095]: WARNING nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received unexpected event network-vif-plugged-cd16e6b9-9b55-4348-a850-701d19409382 for instance with vm_state active and task_state deleting.
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-6fda67fc-1aad-4e9a-bd83-8e907d4cfa3a req-26ae7566-5ce5-450e-9508-300d2fdebe38 service nova] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Received event network-vif-deleted-cd16e6b9-9b55-4348-a850-701d19409382 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:02:25 user nova-compute[75095]: INFO nova.compute.manager [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: 83f377d2-5f86-4065-8e9d-ab9beda7f396] Took 0.81 seconds to detach 1 volumes for instance.
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:25 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:02:26 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:02:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:26 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance 83f377d2-5f86-4065-8e9d-ab9beda7f396
Nov 15 16:02:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3713aeb7-ac01-40fe-b291-1012424036e8 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "83f377d2-5f86-4065-8e9d-ab9beda7f396" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.802s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:26 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:02:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:02:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:02:33 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:02:33 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=7938MB free_disk=24.25225830078125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 4caf1ff5-2201-454c-a281-858e96175bab actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec7bc0c6-c339-49e8-94b9-f0cb87154756 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:02:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:34 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:02:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:34 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:02:34 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:02:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:02:35 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:35 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:02:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:02:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:57 user nova-compute[75095]: INFO nova.compute.manager [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Unrescuing
Nov 15 16:02:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:02:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:02:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'flavor' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance destroyed successfully.
Nov 15 16:02:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:02:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6ee2b0dd-e1c9-47ad-bbda-996e6a3c2af4 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:03 user nova-compute[75095]: WARNING nova.compute.manager [req-904e8aa0-1f17-4555-b037-ad3db08c2d75 req-92ff6501-c4f8-4a21-ab35-1be528c911a6 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state None.
Nov 15 16:03:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:05 user nova-compute[75095]: WARNING nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state None.
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:05 user nova-compute[75095]: WARNING nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state None.
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:05 user nova-compute[75095]: WARNING nova.compute.manager [req-1025a9c2-1a51-4f2a-844c-aa6b278bf863 req-0ac323bf-ab6f-4376-bfba-1509e6fde068 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state active and task_state None.
Nov 15 16:03:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:03:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:07 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:03:07 user nova-compute[75095]: INFO nova.compute.claims [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Claim successful on node user
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:03:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:03:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Creating image(s)
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "2490d978eca157bd3393547effd7c19ec4974b3c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "2490d978eca157bd3393547effd7c19ec4974b3c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG nova.policy [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae4c178bfe944f58a004a7f15795121b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e3ee465fc544fe81da6ef40da50d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG nova.virt.images [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] bcb00b7d-95fa-4eb7-a88f-27905055325e was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.part /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.part /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.converted" returned: 0 in 0.131s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "2490d978eca157bd3393547effd7c19ec4974b3c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.956s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Successfully created port: 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "2490d978eca157bd3393547effd7c19ec4974b3c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "2490d978eca157bd3393547effd7c19ec4974b3c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c,backing_fmt=raw /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c,backing_fmt=raw /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk 1073741824" returned: 0 in 0.046s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "2490d978eca157bd3393547effd7c19ec4974b3c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:03:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Successfully updated port: 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing instance network info cache due to event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Cannot resize image /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Ensure instance console log exists: /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance network_info: |[{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start _get_guest_xml network_info=[{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T16:03:05Z,direct_url=<?>,disk_format='qcow2',id=bcb00b7d-95fa-4eb7-a88f-27905055325e,min_disk=0,min_ram=0,name='tempest-scenario-img--1530623204',owner='56e3ee465fc544fe81da6ef40da50d48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T16:03:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': 'bcb00b7d-95fa-4eb7-a88f-27905055325e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:03:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:03:10 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T16:03:05Z,direct_url=<?>,disk_format='qcow2',id=bcb00b7d-95fa-4eb7-a88f-27905055325e,min_disk=0,min_ram=0,name='tempest-scenario-img--1530623204',owner='56e3ee465fc544fe81da6ef40da50d48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T16:03:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:03:08Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:03:10 user nova-compute[75095]:   <uuid>8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</uuid>
Nov 15 16:03:10 user nova-compute[75095]:   <name>instance-0000002a</name>
Nov 15 16:03:10 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:03:10 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:03:10 user nova-compute[75095]:   <metadata>
Nov 15 16:03:10 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:03:10 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:name>tempest-TestMinimumBasicScenario-server-266246347</nova:name>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:03:10</nova:creationTime>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:03:10 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:03:10 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:owner>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:user uuid="ae4c178bfe944f58a004a7f15795121b">tempest-TestMinimumBasicScenario-844854400-project-member</nova:user>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:project uuid="56e3ee465fc544fe81da6ef40da50d48">tempest-TestMinimumBasicScenario-844854400</nova:project>
Nov 15 16:03:10 user nova-compute[75095]:       </nova:owner>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:root type="image" uuid="bcb00b7d-95fa-4eb7-a88f-27905055325e"/>
Nov 15 16:03:10 user nova-compute[75095]:       <nova:ports>
Nov 15 16:03:10 user nova-compute[75095]:         <nova:port uuid="4ac10c93-9173-477e-ad4c-c3f25758c16c">
Nov 15 16:03:10 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 16:03:10 user nova-compute[75095]:         </nova:port>
Nov 15 16:03:10 user nova-compute[75095]:       </nova:ports>
Nov 15 16:03:10 user nova-compute[75095]:     </nova:instance>
Nov 15 16:03:10 user nova-compute[75095]:   </metadata>
Nov 15 16:03:10 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:03:10 user nova-compute[75095]:     <system>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="serial">8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</entry>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="uuid">8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</entry>
Nov 15 16:03:10 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:03:10 user nova-compute[75095]:     </system>
Nov 15 16:03:10 user nova-compute[75095]:   </sysinfo>
Nov 15 16:03:10 user nova-compute[75095]:   <os>
Nov 15 16:03:10 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:03:10 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:03:10 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:03:10 user nova-compute[75095]:   </os>
Nov 15 16:03:10 user nova-compute[75095]:   <features>
Nov 15 16:03:10 user nova-compute[75095]:     <acpi/>
Nov 15 16:03:10 user nova-compute[75095]:     <apic/>
Nov 15 16:03:10 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:03:10 user nova-compute[75095]:   </features>
Nov 15 16:03:10 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:03:10 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:03:10 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:03:10 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:03:10 user nova-compute[75095]:   </clock>
Nov 15 16:03:10 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:03:10 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:03:10 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:03:10 user nova-compute[75095]:   </cpu>
Nov 15 16:03:10 user nova-compute[75095]:   <devices>
Nov 15 16:03:10 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:03:10 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:03:10 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk"/>
Nov 15 16:03:10 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:03:10 user nova-compute[75095]:     </disk>
Nov 15 16:03:10 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:03:10 user nova-compute[75095]:       <mac address="fa:16:3e:8f:1c:a7"/>
Nov 15 16:03:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:03:10 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:03:10 user nova-compute[75095]:       <target dev="tap4ac10c93-91"/>
Nov 15 16:03:10 user nova-compute[75095]:     </interface>
Nov 15 16:03:10 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:03:10 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/console.log" append="off"/>
Nov 15 16:03:10 user nova-compute[75095]:     </serial>
Nov 15 16:03:10 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:03:10 user nova-compute[75095]:     <video>
Nov 15 16:03:10 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:03:10 user nova-compute[75095]:     </video>
Nov 15 16:03:10 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:03:10 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:03:10 user nova-compute[75095]:     </rng>
Nov 15 16:03:10 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:03:10 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:03:10 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:03:10 user nova-compute[75095]:     </memballoon>
Nov 15 16:03:10 user nova-compute[75095]:   </devices>
Nov 15 16:03:10 user nova-compute[75095]: </domain>
Nov 15 16:03:10 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:03:08Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG os_vif [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9b867c1-d5a2-59f0-9293-9ba130eaa576', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ac10c93-91, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ac10c93-91, col_values=(('qos', UUID('2309f0ab-cccf-4383-b2de-27a46724cc41')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ac10c93-91, col_values=(('external_ids', {'iface-id': '4ac10c93-9173-477e-ad4c-c3f25758c16c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:1c:a7', 'vm-uuid': '8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:10 user nova-compute[75095]: INFO os_vif [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91')
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No VIF found with MAC fa:16:3e:8f:1c:a7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated VIF entry in instance network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b2fb7dca-5263-49f2-be9c-e18c28fb1a03 req-fe3c9fec-f7b0-448c-835d-3b8c0dd5250c service nova] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:03:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:12 user nova-compute[75095]: WARNING nova.compute.manager [req-a0d3a7b8-2a55-4fb0-bfd3-89f6ef7d0edf req-1fc59baf-5a99-46b7-b2c6-193ef00716fb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state building and task_state spawning.
Nov 15 16:03:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:03:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance spawned successfully.
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:14 user nova-compute[75095]: INFO nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:14 user nova-compute[75095]: DEBUG nova.compute.manager [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:14 user nova-compute[75095]: WARNING nova.compute.manager [req-c75f8bc3-581d-4c5f-8be7-c2e50b37b38c req-c0393b4c-41bd-4d9b-b06d-fe98b77d8ee4 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state building and task_state spawning.
Nov 15 16:03:14 user nova-compute[75095]: INFO nova.compute.manager [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Took 6.49 seconds to build instance.
Nov 15 16:03:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-92988c66-cb13-47ac-800c-22cbdf0ddfcb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.585s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:16 user nova-compute[75095]: INFO nova.compute.manager [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Terminating instance
Nov 15 16:03:16 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-19460336-7e9b-46bc-8aa7-17e56dbb8c1e req-bf4939c2-10ba-4397-ac79-bf4a9370818f service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-unplugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:03:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Instance destroyed successfully.
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 4caf1ff5-2201-454c-a281-858e96175bab {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:57:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-431249798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-431249798',id=36,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:59:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-5sy1pa47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:01:30Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=4caf1ff5-2201-454c-a281-858e96175bab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "address": "fa:16:3e:2b:70:c1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fc2f0c5-de", "ovs_interfaceid": "9fc2f0c5-de35-4c21-8d68-b03e1e42be39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_vif [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fc2f0c5-de, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33243eb1-348c-4ec0-8ffc-454d20bc6151) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:17 user nova-compute[75095]: INFO os_vif [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:70:c1,bridge_name='br-int',has_traffic_filtering=True,id=9fc2f0c5-de35-4c21-8d68-b03e1e42be39,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fc2f0c5-de')
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxJqeZba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:03:17 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb623800-aff3-4e8e-ad98-1639e8b03f88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:03:17 user nova-compute[75095]: No targets found.
Nov 15 16:03:17 user nova-compute[75095]: iSNS:
Nov 15 16:03:17 user nova-compute[75095]: No targets found.
Nov 15 16:03:17 user nova-compute[75095]: STATIC:
Nov 15 16:03:17 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:03:17 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:17 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:17 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:03:17 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:17 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:17 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:03:17 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:17 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:17 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd
Nov 15 16:03:17 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:17 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:17 user nova-compute[75095]: FIRMWARE:
Nov 15 16:03:17 user nova-compute[75095]: No targets found.
Nov 15 16:03:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:03:17 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:03:17 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6b0d0c-68c9-4e61-b971-72e4fdef031a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c87fd34-fe49-4af1-a5b9-d8fe51da22b4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:03:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2eaf80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[71efedc9-bf73-49eb-9873-feee753aaad6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3495197-dd4f-448f-b92c-acbf9ffd99da]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a258618a-edd5-40f5-bad2-b77394bd32ba]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e0f354-d061-49d5-b114-3bf8968a73d7]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d05268-34dc-4503-b056-416cd2a73dbb]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd4d148-e8a7-4beb-90d4-3c2e2f253bb9]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260]
Nov 15 16:03:17 user nova-compute[75095]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd, portal: 172.16.0.220,3260] successful.
Nov 15 16:03:17 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f801279c-b736-4d16-a8a7-c5b6138697bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[601a2ed3-e990-452f-a034-d1610b04ad4d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== disconnect_volume: return (283ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:03:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Deleting instance files /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab_del
Nov 15 16:03:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Deletion of /opt/stack/data/nova/instances/4caf1ff5-2201-454c-a281-858e96175bab_del complete
Nov 15 16:03:17 user nova-compute[75095]: INFO nova.compute.manager [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 15 16:03:17 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:03:17 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:18 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Took 0.46 seconds to deallocate network for instance.
Nov 15 16:03:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-4153ee1c-0ac2-452c-9101-1ad3239bea06 req-a8550f5f-48d2-4c77-be0b-b05161fe7b38 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-deleted-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing instance network info cache due to event network-changed-b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] Acquiring lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] Acquired lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:03:18 user nova-compute[75095]: DEBUG nova.network.neutron [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Refreshing network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:03:19 user nova-compute[75095]: INFO nova.compute.manager [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:19 user nova-compute[75095]: INFO nova.compute.manager [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Terminating instance
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] Acquiring lock "4caf1ff5-2201-454c-a281-858e96175bab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] Lock "4caf1ff5-2201-454c-a281-858e96175bab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] No waiting events found dispatching network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:19 user nova-compute[75095]: WARNING nova.compute.manager [req-930505bc-d3a2-4915-ab6b-1c73657fc79a req-eee916b4-28a6-47c4-8b7b-5e4d29831791 service nova] [instance: 4caf1ff5-2201-454c-a281-858e96175bab] Received unexpected event network-vif-plugged-9fc2f0c5-de35-4c21-8d68-b03e1e42be39 for instance with vm_state deleted and task_state None.
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updated VIF entry in instance network info cache for port b84d29d2-9f88-4c67-b3b7-5d03b7409e65. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [{"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c3d4ab9-f1e3-4be6-b5f0-f5c3aabd5529 req-33806d53-1b36-4fb1-aa24-b73ab61d5288 service nova] Releasing lock "refresh_cache-ec7bc0c6-c339-49e8-94b9-f0cb87154756" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:03:19 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Deleted allocations for instance 4caf1ff5-2201-454c-a281-858e96175bab
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1e95c272-547c-4f2f-9217-739cfdf3fc9b tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "4caf1ff5-2201-454c-a281-858e96175bab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.015s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:03:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Instance destroyed successfully.
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.objects.instance [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lazy-loading 'resources' on Instance uuid ec7bc0c6-c339-49e8-94b9-f0cb87154756 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1679251584',display_name='tempest-TestVolumeBootPattern-server-1679251584',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1679251584',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCf7QjQHmeiFCIlaWKVIImg5+9659rvIs+AzZaBE77hwu45AYWrjo2vD066WDc1BcYnVY+spm+o9i+DlasZsHicJjSmrjHxWV/v9ysZLorOQyvP/XboE/I5EUd4sZx1sw==',key_name='tempest-TestVolumeBootPattern-2023517',keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:58:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='411ae82aac4242d6a14fd6625204b8fd',ramdisk_id='',reservation_id='r-djeu0ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108978395',owner_user_name='tempest-TestVolumeBootPattern-2108978395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:58:42Z,user_data=None,user_id='f02f7b31bee84b1790581da3ffa3c249',uuid=ec7bc0c6-c339-49e8-94b9-f0cb87154756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converting VIF {"id": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "address": "fa:16:3e:55:4c:55", "network": {"id": "0136c8b7-58c7-4ea5-873d-e64f8d1f12a7", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1982706209-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "411ae82aac4242d6a14fd6625204b8fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb84d29d2-9f", "ovs_interfaceid": "b84d29d2-9f88-4c67-b3b7-5d03b7409e65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_vif [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb84d29d2-9f, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbfb6634-fce6-427a-8834-7ee0a3a23d5e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:03:19 user nova-compute[75095]: INFO os_vif [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:55,bridge_name='br-int',has_traffic_filtering=True,id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65,network=Network(0136c8b7-58c7-4ea5-873d-e64f8d1f12a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb84d29d2-9f')
Nov 15 16:03:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OxtRwJqj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:03:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b90d98a-6dbe-47ba-95c2-caebbcbb9a82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:03:19 user nova-compute[75095]: No targets found.
Nov 15 16:03:19 user nova-compute[75095]: iSNS:
Nov 15 16:03:19 user nova-compute[75095]: No targets found.
Nov 15 16:03:19 user nova-compute[75095]: STATIC:
Nov 15 16:03:19 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:03:19 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:19 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:19 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:03:19 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:19 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:19 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335
Nov 15 16:03:19 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:03:19 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:03:19 user nova-compute[75095]: FIRMWARE:
Nov 15 16:03:19 user nova-compute[75095]: No targets found.
Nov 15 16:03:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:03:19 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:03:19 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff55276-1451-4100-95ee-fd4057d79166]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66fd50c-5746-4ca6-a8f6-9c3a3630bd6b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:03:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1fe8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87066f77-4033-44f4-a4ad-23a9cb0b63ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b9d1d-b219-46c0-84bb-02e9c95e4644]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4184abab-680c-4a1e-9f12-a02a0245206e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48ef91a-db1f-40ef-b066-fcc7e38a6880]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b99db7-76bd-4a9c-a6fe-f6cd088811d8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e073d0-fa2a-49b5-8b53-108a4b2e4891]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260]
Nov 15 16:03:20 user nova-compute[75095]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335, portal: 172.16.0.220,3260] successful.
Nov 15 16:03:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4d3a3e4c-6ebc-4ba6-b6dc-0c5d0b275335 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd6b510-f914-4cb6-a7b6-1fd3b6f1c213]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] <== disconnect_volume: return (333ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:03:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Deleting instance files /opt/stack/data/nova/instances/ec7bc0c6-c339-49e8-94b9-f0cb87154756_del
Nov 15 16:03:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Deletion of /opt/stack/data/nova/instances/ec7bc0c6-c339-49e8-94b9-f0cb87154756_del complete
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:03:20 user nova-compute[75095]: INFO nova.compute.manager [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 16:03:20 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:20 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Took 0.36 seconds to deallocate network for instance.
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-f6137192-a0f1-42dd-a0e5-9aaa7603c3c9 req-1d5527f4-f406-4b14-b276-aea3b35e7d3e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-deleted-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:20 user nova-compute[75095]: INFO nova.compute.manager [req-f6137192-a0f1-42dd-a0e5-9aaa7603c3c9 req-1d5527f4-f406-4b14-b276-aea3b35e7d3e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Neutron deleted interface b84d29d2-9f88-4c67-b3b7-5d03b7409e65; detaching it from the instance and deleting it from the info cache
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.network.neutron [req-f6137192-a0f1-42dd-a0e5-9aaa7603c3c9 req-1d5527f4-f406-4b14-b276-aea3b35e7d3e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-f6137192-a0f1-42dd-a0e5-9aaa7603c3c9 req-1d5527f4-f406-4b14-b276-aea3b35e7d3e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Detach interface failed, port_id=b84d29d2-9f88-4c67-b3b7-5d03b7409e65, reason: Instance ec7bc0c6-c339-49e8-94b9-f0cb87154756 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-unplugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] No waiting events found dispatching network-vif-unplugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-unplugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Acquiring lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] No waiting events found dispatching network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:21 user nova-compute[75095]: WARNING nova.compute.manager [req-e8b11eac-c21d-4158-b458-a8819cb48b5a req-0a813628-364a-441a-b3ed-66f1001d6b5e service nova] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Received unexpected event network-vif-plugged-b84d29d2-9f88-4c67-b3b7-5d03b7409e65 for instance with vm_state active and task_state deleting.
Nov 15 16:03:21 user nova-compute[75095]: INFO nova.compute.manager [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] [instance: ec7bc0c6-c339-49e8-94b9-f0cb87154756] Took 0.94 seconds to detach 1 volumes for instance.
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:03:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:21 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Deleted allocations for instance ec7bc0c6-c339-49e8-94b9-f0cb87154756
Nov 15 16:03:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-544d52f1-d1a7-41a3-842e-4c5d89d8cc62 tempest-TestVolumeBootPattern-2108978395 tempest-TestVolumeBootPattern-2108978395-project-member] Lock "ec7bc0c6-c339-49e8-94b9-f0cb87154756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.984s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:25 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:26 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:03:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:03:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:35 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:03:35 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8031MB free_disk=24.15273666381836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:03:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.612s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:03:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:03:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:03:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing instance network info cache due to event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updated VIF entry in instance network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:03:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-94949a17-dcf3-4562-84ad-487d640599b0 req-ccdfae2d-2f7d-4aa4-93cb-906a3a7dbc17 service nova] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:58 user nova-compute[75095]: INFO nova.compute.manager [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Shelving
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:03:58 user nova-compute[75095]: WARNING nova.compute.manager [req-b83bfac9-0030-4c28-9761-dd79ccc9fa81 req-e88df22c-a932-43f9-9a17-f748286fb2fe service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state active and task_state shelving.
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance destroyed successfully.
Nov 15 16:03:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Beginning cold snapshot process
Nov 15 16:03:59 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:03:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk /opt/stack/data/nova/instances/snapshots/tmpj0dv_1hg/efd95a4497364a13b3f5085acd533fd4 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:03:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:03:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk /opt/stack/data/nova/instances/snapshots/tmpj0dv_1hg/efd95a4497364a13b3f5085acd533fd4" returned: 0 in 0.491s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:03:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Snapshot extracted, beginning image upload
Nov 15 16:03:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:04:00 user nova-compute[75095]: WARNING nova.compute.manager [req-ba575f2b-0b8e-42d0-b677-a8899bb8a4a1 req-c7c9d563-2004-4196-a7b2-ed4ec2affa8a service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 16:04:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Snapshot image upload complete
Nov 15 16:04:01 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:04:02 user nova-compute[75095]: INFO nova.compute.manager [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Shelve offloading
Nov 15 16:04:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance destroyed successfully.
Nov 15 16:04:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:04:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:04:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:04:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:04:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:04:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance destroyed successfully.
Nov 15 16:04:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'resources' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHBDJGYyfD1DBITBa/Hh25RKCW5SlVvxFT8lI0nijgCo3VtMKc27yI9I8JHX2lMtaWryHGhH51kQzW33mWQv+MwthKqYjYdxFi8GWPsj0s5v0ppEUJZrIfby0OtcGh0fQ==',key_name='tempest-keypair-1521200829',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:04:01.932957',shelved_host='user',shelved_image_id='fed3aee9-3b77-42a3-b312-61f00eb49e2a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:04:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG os_vif [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc72bac14-43, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcc27770-3724-4c06-a163-e64702b00dbd) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:03 user nova-compute[75095]: INFO os_vif [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43')
Nov 15 16:04:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Deleting instance files /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac_del
Nov 15 16:04:03 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Deletion of /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac_del complete
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing instance network info cache due to event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.network.neutron [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:04:03 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Deleted allocations for instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.objects.base [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac> lazy-loaded attributes: resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.network.neutron [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updated VIF entry in instance network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.network.neutron [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc72bac14-43", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e36c4794-70f2-4af1-8eb4-7a9135b83f9c req-d1a4b73b-7273-4244-8790-9507b11f9b02 service nova] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d09ebc84-ee08-42a3-a181-85c7ad4cc5a9 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.284s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:07 user nova-compute[75095]: INFO nova.compute.manager [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Terminating instance
Nov 15 16:04:07 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-unplugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] No waiting events found dispatching network-vif-unplugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-85346e5e-d378-49bb-9808-5fb9b31123e1 req-c08dbd9c-3e92-40fe-98d4-8feb7d4fc834 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-unplugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Instance destroyed successfully.
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 7ba34aca-dade-4f88-bdda-c8b4837f87aa {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:53:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-63914110',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-63914110',id=33,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:54:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-rufm04gt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:55:51Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=7ba34aca-dade-4f88-bdda-c8b4837f87aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "address": "fa:16:3e:d2:9e:0f", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95a5dd21-f3", "ovs_interfaceid": "95a5dd21-f300-4c4f-b4dd-c386ea5afe37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG os_vif [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95a5dd21-f3, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=084936bf-8f39-4558-b752-f29765bc30b5) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:08 user nova-compute[75095]: INFO os_vif [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:9e:0f,bridge_name='br-int',has_traffic_filtering=True,id=95a5dd21-f300-4c4f-b4dd-c386ea5afe37,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95a5dd21-f3')
Nov 15 16:04:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Deleting instance files /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa_del
Nov 15 16:04:08 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Deletion of /opt/stack/data/nova/instances/7ba34aca-dade-4f88-bdda-c8b4837f87aa_del complete
Nov 15 16:04:08 user nova-compute[75095]: INFO nova.compute.manager [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 16:04:08 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:08 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Took 0.54 seconds to deallocate network for instance.
Nov 15 16:04:08 user nova-compute[75095]: DEBUG nova.compute.manager [req-fd5e93a4-4f60-4798-b2a3-213469be8c26 req-88c0bc67-bcdd-4877-8d19-74111a189f67 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-deleted-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.231s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:09 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Deleted allocations for instance 7ba34aca-dade-4f88-bdda-c8b4837f87aa
Nov 15 16:04:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1b959e03-9338-4031-958f-5d3dbda46fe8 tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.603s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] Acquiring lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] Lock "7ba34aca-dade-4f88-bdda-c8b4837f87aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] No waiting events found dispatching network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:04:09 user nova-compute[75095]: WARNING nova.compute.manager [req-49202b4b-f34a-4bf9-b81d-f5b8d5bdd6d4 req-5e171189-63ee-456c-aad7-9d0bba817ff9 service nova] [instance: 7ba34aca-dade-4f88-bdda-c8b4837f87aa] Received unexpected event network-vif-plugged-95a5dd21-f300-4c4f-b4dd-c386ea5afe37 for instance with vm_state deleted and task_state None.
Nov 15 16:04:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:04:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:04:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:04:21 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:04:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [{"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:04:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:04:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:27 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:04:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:04:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:04:36 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:04:36 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=24.254005432128906GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 82639568-19ea-4e63-a23f-c70ead2b2ca6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:04:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:04:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing instance network info cache due to event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updated VIF entry in instance network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-271b1cd7-55e9-448c-b05e-9412efea3a01 req-bd071ce0-962a-4da9-a460-05cea56b8598 service nova] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:49 user nova-compute[75095]: INFO nova.compute.manager [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Detaching volume 43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:04:49 user nova-compute[75095]: INFO nova.virt.block_device [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Attempting to driver detach volume 43fbd59c-0852-4df0-8451-2048e302b677 from mountpoint /dev/vdb
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Attempting to detach device vdb from instance 2fac940f-34d2-401e-ad63-b60436b81807 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:04:49 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:04:49 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 16:04:49 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:04:49 user nova-compute[75095]:   <serial>43fbd59c-0852-4df0-8451-2048e302b677</serial>
Nov 15 16:04:49 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:04:49 user nova-compute[75095]: </disk>
Nov 15 16:04:49 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:04:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully detached device vdb from instance 2fac940f-34d2-401e-ad63-b60436b81807 from the persistent domain config.
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fac940f-34d2-401e-ad63-b60436b81807 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:04:49 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:04:49 user nova-compute[75095]:   <source dev="/dev/sde"/>
Nov 15 16:04:49 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:04:49 user nova-compute[75095]:   <serial>43fbd59c-0852-4df0-8451-2048e302b677</serial>
Nov 15 16:04:49 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:04:49 user nova-compute[75095]: </disk>
Nov 15 16:04:49 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:04:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing instance network info cache due to event network-changed-85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Refreshing network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updated VIF entry in instance network info cache for port 85c7b24d-5d78-4a1a-904c-002d4a0276aa. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG nova.network.neutron [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-25f2db45-c286-4399-87d0-9762b21951fe req-a76268f3-20cf-4987-ac83-17450fffa698 service nova] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:04:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:58 user nova-compute[75095]: INFO nova.compute.manager [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Terminating instance
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-02d8b92d-d8a0-43e8-9084-b26f9376a7f6 req-7d061432-c308-4710-ac5d-aa61c1192a97 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-unplugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Instance destroyed successfully.
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.objects.instance [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 82639568-19ea-4e63-a23f-c70ead2b2ca6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:48:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-964997264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-964997264',id=21,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:50:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-86sje3pg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:52:08Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=82639568-19ea-4e63-a23f-c70ead2b2ca6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "d2faa453-bbaa-47be-b0ed-78821863719b", "address": "fa:16:3e:87:51:f1", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2faa453-bb", "ovs_interfaceid": "d2faa453-bbaa-47be-b0ed-78821863719b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_vif [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2faa453-bb, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00a8a971-dbcc-44f8-b695-397f6b4c389f) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:04:58 user nova-compute[75095]: INFO os_vif [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:51:f1,bridge_name='br-int',has_traffic_filtering=True,id=d2faa453-bbaa-47be-b0ed-78821863719b,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2faa453-bb')
Nov 15 16:04:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PamiElgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:04:58 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df4593b-fadd-41ae-aa97-be137e75f61a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:04:58 user nova-compute[75095]: No targets found.
Nov 15 16:04:58 user nova-compute[75095]: iSNS:
Nov 15 16:04:58 user nova-compute[75095]: No targets found.
Nov 15 16:04:58 user nova-compute[75095]: STATIC:
Nov 15 16:04:58 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:04:58 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:04:58 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:04:58 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91
Nov 15 16:04:58 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:04:58 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:04:58 user nova-compute[75095]: FIRMWARE:
Nov 15 16:04:58 user nova-compute[75095]: No targets found.
Nov 15 16:04:58 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:04:58 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:04:58 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be92c6-dc51-4957-998a-52fd1f184b24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01727baa-b67b-42f1-a5cc-89b3621f33c8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:04:58 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:04:58 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 (non-flash)
Nov 15 16:04:58 user nova-compute[75095]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:04:58 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1fe290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91'): ({'sdf'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Removing single pathed devices sdf {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808c301-e314-480c-9913-4e28a24e8524]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c769b58b-3cd0-4680-a9da-e21ec1b41da6]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:58 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Flushing IO for device /dev/sdf {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2cd9cc-c058-4ff1-9078-7cbc82413eb4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.066s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538f3cb-6b3a-44e0-97b7-5dc0c9681274]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] SCSI volumes sdf have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e53cb3-4702-4b4f-9bf8-640dba1d9ac4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[818411ca-fccf-4f6a-9894-27a92f8df2b2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260]
Nov 15 16:04:59 user nova-compute[75095]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91, portal: 172.16.0.220,3260] successful.
Nov 15 16:04:59 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:043b0d1f-799c-41db-9daa-4cbb00e1ac91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fe1ba8-5cb7-4eb8-9794-d77d3a64086a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] <== disconnect_volume: return (321ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:04:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Deleting instance files /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6_del
Nov 15 16:04:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Deletion of /opt/stack/data/nova/instances/82639568-19ea-4e63-a23f-c70ead2b2ca6_del complete
Nov 15 16:04:59 user nova-compute[75095]: INFO nova.compute.manager [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 16:04:59 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:04:59 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:04:59 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Took 0.56 seconds to deallocate network for instance.
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:00 user nova-compute[75095]: INFO nova.compute.manager [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Attaching volume 8cd3f4c2-0429-4496-9e95-bf7f1829035c to /dev/vdb
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.utils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6f3d9-2cd8-416d-ac26-80e8449057e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ca9702-f0ec-4d0a-add5-c56a0c1d5abb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45993dd5-c700-49e7-9546-9ca2590fe42a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec0348e-3bdf-4ebf-aed5-562175f76670]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:05:00 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7885b467-3840-410a-a552-086c692756bf]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG os_brick.utils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating existing volume attachment record: aa99b964-460d-4a83-a5d1-c67f08b5217a {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] Acquiring lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] No waiting events found dispatching network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:00 user nova-compute[75095]: WARNING nova.compute.manager [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received unexpected event network-vif-plugged-d2faa453-bbaa-47be-b0ed-78821863719b for instance with vm_state active and task_state deleting.
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-dd0fe409-631b-473f-80e5-039bb5da812a req-1fcd880f-f24d-4947-90dd-cb3f8635a570 service nova] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Received event network-vif-deleted-d2faa453-bbaa-47be-b0ed-78821863719b {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:00 user nova-compute[75095]: INFO nova.compute.manager [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 82639568-19ea-4e63-a23f-c70ead2b2ca6] Took 0.73 seconds to detach 1 volumes for instance.
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:00 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Deleted allocations for instance 82639568-19ea-4e63-a23f-c70ead2b2ca6
Nov 15 16:05:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-4d9dd619-08de-4861-9260-5ad8d8e1003d tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "82639568-19ea-4e63-a23f-c70ead2b2ca6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.910s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:04 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[241cb49c-c2d1-4ca4-a152-b50ddb9dc2eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:05:04 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c18672-6e24-42ca-af44-c50172301903]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c] added
Nov 15 16:05:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed3fa3-0112-4eb5-a81f-18f7d611814a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbb74c6-dbc7-41cf-81f4-e2bc07ca51f7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Gnyevmxt {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Gnyevmxt" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86648f23-8eeb-4e31-9b2c-511546b88f06]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Gnyevmxt'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cea4f8-75e0-4d93-8ea1-c6baaf368181]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fcbe97-7ff4-4319-aadf-f883c6425e5e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5407b9ce-b4ad-4cb8-9574-739834d9a507]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]
Nov 15 16:05:05 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.
Nov 15 16:05:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[662f2aa2-4e24-476d-b1dd-1ef3159a3304]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1c70c0-1691-439b-8245-6276c532f577]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:05 user nova-compute[75095]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:05 user nova-compute[75095]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:05 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c0954-c85c-4899-81b7-32b2305bb769]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:05:05 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26462396566386535', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462396566386535', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:05:06 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:05:06 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:05:06 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:05:06 user nova-compute[75095]:   <serial>8cd3f4c2-0429-4496-9e95-bf7f1829035c</serial>
Nov 15 16:05:06 user nova-compute[75095]: </disk>
Nov 15 16:05:06 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No VIF found with MAC fa:16:3e:8f:1c:a7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:05:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5ee71cf2-dc8d-434f-88b2-09c82da02765 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.483s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:05:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:09 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fac940f-34d2-401e-ad63-b60436b81807 is timed out.
Nov 15 16:05:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully detached device vdb from instance 2fac940f-34d2-401e-ad63-b60436b81807 from the live domain config.
Nov 15 16:05:09 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:05:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHeglCpW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:09 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78165cf-90d8-4b2a-b895-05345c91b09a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:05:10 user nova-compute[75095]: No targets found.
Nov 15 16:05:10 user nova-compute[75095]: iSNS:
Nov 15 16:05:10 user nova-compute[75095]: No targets found.
Nov 15 16:05:10 user nova-compute[75095]: STATIC:
Nov 15 16:05:10 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677
Nov 15 16:05:10 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:05:10 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:05:10 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c
Nov 15 16:05:10 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:05:10 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:05:10 user nova-compute[75095]: FIRMWARE:
Nov 15 16:05:10 user nova-compute[75095]: No targets found.
Nov 15 16:05:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:05:10 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:05:10 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28bf47a-f2dd-4307-8ef7-47e69e1da2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9887e6-00d0-4cd3-8d5f-107d3174ceba]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:10 user nova-compute[75095]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 (non-flash)
Nov 15 16:05:10 user nova-compute[75095]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677'): ({'sde'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Removing single pathed devices sde {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da95c4-a386-42d7-b9db-b08dd59db9b5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a534138-fd65-49aa-89bf-25604006ad32]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Flushing IO for device /dev/sde {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f8714-21fd-40bc-a1a7-9c99d516e552]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f5ff97-182c-472e-93e8-5c0f74cb37ec]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] SCSI volumes sde have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f0e386-77aa-4a88-9ffa-f89607f5d5bc]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0556cde2-3dd4-45f2-8a47-f673662ba310]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260]
Nov 15 16:05:10 user nova-compute[75095]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677, portal: 172.16.0.220,3260] successful.
Nov 15 16:05:10 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43fbd59c-0852-4df0-8451-2048e302b677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b831330d-886a-4d40-b3a3-4a2d16c39cd3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] <== disconnect_volume: return (319ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:05:11 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'flavor' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5998e21f-56c6-4595-8ea3-201b2090d54c tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.769s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing instance network info cache due to event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:05:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:05:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated VIF entry in instance network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:05:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-0781b029-522e-411d-b862-399f34c5ba78 req-45c75b27-63ea-48d6-b792-8019bd4d041b service nova] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing instance network info cache due to event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated VIF entry in instance network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG nova.network.neutron [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6b48a09b-d23d-4703-a8f1-4eb64c422877 req-da486630-b6e0-4815-a22e-485707c6a6b9 service nova] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:18 user nova-compute[75095]: INFO nova.compute.manager [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Rebooting instance
Nov 15 16:05:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:18 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:19 user nova-compute[75095]: WARNING nova.compute.manager [req-d86b1ad7-2f5d-48d9-8f0c-7ac7f10d3629 req-e6f507e8-0ba9-434c-9775-bc54dc58918f service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state active and task_state reboot_started_hard.
Nov 15 16:05:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance destroyed successfully.
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'resources' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:05:19Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ac10c93-91, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2309f0ab-cccf-4383-b2de-27a46724cc41) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:19 user nova-compute[75095]: INFO os_vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91')
Nov 15 16:05:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e2c138-2d77-4435-a143-158ace66b8b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:05:19 user nova-compute[75095]: No targets found.
Nov 15 16:05:19 user nova-compute[75095]: iSNS:
Nov 15 16:05:19 user nova-compute[75095]: No targets found.
Nov 15 16:05:19 user nova-compute[75095]: STATIC:
Nov 15 16:05:19 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c
Nov 15 16:05:19 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:05:19 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:05:19 user nova-compute[75095]: FIRMWARE:
Nov 15 16:05:19 user nova-compute[75095]: No targets found.
Nov 15 16:05:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:05:19 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:05:19 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[24867032-a32f-4043-8393-bfe6cfe551d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[26360a2a-6b12-48c7-8287-0f97b3559ba5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c233d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c53fa30-6401-46e3-8ca6-8a1c08098159]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8984bf-44ee-4a0d-97af-3d751a1bedaf]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4099bf-8b9f-4112-b041-c960810b285e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:05:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d195e7e6-600a-4f3c-8ee3-c1b1713b2071]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ede8df-8b1f-44a8-832e-a1f28275c485]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0927e32-d0ea-4caa-b030-0e219ff615b7]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]
Nov 15 16:05:20 user nova-compute[75095]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.
Nov 15 16:05:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3b667-959e-4521-9b50-0bc095ba7317]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== disconnect_volume: return (277ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start _get_guest_xml network_info=[{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bcb00b7d-95fa-4eb7-a88f-27905055325e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': 'bcb00b7d-95fa-4eb7-a88f-27905055325e'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': 'aa99b964-460d-4a83-a5d1-c67f08b5217a', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed', 'attached_at': '', 'detached_at': '', 'volume_id': '8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'serial': '8cd3f4c2-0429-4496-9e95-bf7f1829035c'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:05:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:05:20 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=bcb00b7d-95fa-4eb7-a88f-27905055325e,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.objects.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Object Instance<8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed> lazy-loaded attributes: resources,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:05:20 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5470f1a7-9434-4e63-a5ef-29e8d5701d54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:05:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[43009900-b449-4787-940f-10637369b42b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c] added
Nov 15 16:05:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f9240-6011-4811-8822-3dd783492cb8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38a4e26-a9a6-40fa-92f1-00642834e9c1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Gnyevmxt {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Gnyevmxt" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c454c2-24a0-4c06-b25c-ca36dd539868]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Gnyevmxt'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[223cfcc1-0745-497f-b608-5f8c2d8f60bd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd3c71f-cc48-477d-9291-7bffd27bfe4f]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:05:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:05:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:05:20 user nova-compute[75095]: 
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7d2277-0abd-4fd6-ada2-9459d8c0d6e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]
Nov 15 16:05:20 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.
Nov 15 16:05:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb9bcb2-1642-445e-bbe5-296db1dc6541]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13393c49-bdbc-4ed9-8c6a-0c035812f7c6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:05:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a6db57-5bf0-48bd-a74b-22d5d5d9ea97]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:05:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:21 user nova-compute[75095]: WARNING nova.compute.manager [req-b5568fa5-142d-4767-bb8a-6a0d6f07c7f8 req-8a89052a-d9b4-4e40-8ba5-f5201af68c43 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state active and task_state reboot_started_hard.
Nov 15 16:05:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.258s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== connect_volume: return (1260ms) {'type': 'block', 'scsi_wwn': '26462396566386535', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462396566386535', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:05:19Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.objects.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Object Instance<8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:05:21 user nova-compute[75095]:   <uuid>8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</uuid>
Nov 15 16:05:21 user nova-compute[75095]:   <name>instance-0000002a</name>
Nov 15 16:05:21 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:05:21 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:05:21 user nova-compute[75095]:   <metadata>
Nov 15 16:05:21 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:05:21 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:name>tempest-TestMinimumBasicScenario-server-266246347</nova:name>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:05:20</nova:creationTime>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:05:21 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:05:21 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:owner>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:user uuid="ae4c178bfe944f58a004a7f15795121b">tempest-TestMinimumBasicScenario-844854400-project-member</nova:user>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:project uuid="56e3ee465fc544fe81da6ef40da50d48">tempest-TestMinimumBasicScenario-844854400</nova:project>
Nov 15 16:05:21 user nova-compute[75095]:       </nova:owner>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:root type="image" uuid="bcb00b7d-95fa-4eb7-a88f-27905055325e"/>
Nov 15 16:05:21 user nova-compute[75095]:       <nova:ports>
Nov 15 16:05:21 user nova-compute[75095]:         <nova:port uuid="4ac10c93-9173-477e-ad4c-c3f25758c16c">
Nov 15 16:05:21 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 16:05:21 user nova-compute[75095]:         </nova:port>
Nov 15 16:05:21 user nova-compute[75095]:       </nova:ports>
Nov 15 16:05:21 user nova-compute[75095]:     </nova:instance>
Nov 15 16:05:21 user nova-compute[75095]:   </metadata>
Nov 15 16:05:21 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:05:21 user nova-compute[75095]:     <system>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="serial">8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</entry>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="uuid">8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed</entry>
Nov 15 16:05:21 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:05:21 user nova-compute[75095]:     </system>
Nov 15 16:05:21 user nova-compute[75095]:   </sysinfo>
Nov 15 16:05:21 user nova-compute[75095]:   <os>
Nov 15 16:05:21 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:05:21 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:05:21 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:05:21 user nova-compute[75095]:   </os>
Nov 15 16:05:21 user nova-compute[75095]:   <features>
Nov 15 16:05:21 user nova-compute[75095]:     <acpi/>
Nov 15 16:05:21 user nova-compute[75095]:     <apic/>
Nov 15 16:05:21 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:05:21 user nova-compute[75095]:   </features>
Nov 15 16:05:21 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:05:21 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:05:21 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:05:21 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:05:21 user nova-compute[75095]:   </clock>
Nov 15 16:05:21 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:05:21 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:05:21 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:05:21 user nova-compute[75095]:   </cpu>
Nov 15 16:05:21 user nova-compute[75095]:   <devices>
Nov 15 16:05:21 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:05:21 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:05:21 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk"/>
Nov 15 16:05:21 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:05:21 user nova-compute[75095]:     </disk>
Nov 15 16:05:21 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:05:21 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:05:21 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 16:05:21 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 16:05:21 user nova-compute[75095]:       <serial>8cd3f4c2-0429-4496-9e95-bf7f1829035c</serial>
Nov 15 16:05:21 user nova-compute[75095]:     </disk>
Nov 15 16:05:21 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:05:21 user nova-compute[75095]:       <mac address="fa:16:3e:8f:1c:a7"/>
Nov 15 16:05:21 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:05:21 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:05:21 user nova-compute[75095]:       <target dev="tap4ac10c93-91"/>
Nov 15 16:05:21 user nova-compute[75095]:     </interface>
Nov 15 16:05:21 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:05:21 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/console.log" append="off"/>
Nov 15 16:05:21 user nova-compute[75095]:     </serial>
Nov 15 16:05:21 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:05:21 user nova-compute[75095]:     <video>
Nov 15 16:05:21 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:05:21 user nova-compute[75095]:     </video>
Nov 15 16:05:21 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:05:21 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:05:21 user nova-compute[75095]:     </rng>
Nov 15 16:05:21 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:05:21 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:05:21 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:05:21 user nova-compute[75095]:     </memballoon>
Nov 15 16:05:21 user nova-compute[75095]:   </devices>
Nov 15 16:05:21 user nova-compute[75095]: </domain>
Nov 15 16:05:21 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG nova.objects.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Object Instance<8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Cannot resize image /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'migration_context' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.objects.base [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Object Instance<8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:05:19Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG os_vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9b867c1-d5a2-59f0-9293-9ba130eaa576', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ac10c93-91, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ac10c93-91, col_values=(('qos', UUID('6ba2304d-7207-438f-9781-8d37ce3b3cc3')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ac10c93-91, col_values=(('external_ids', {'iface-id': '4ac10c93-9173-477e-ad4c-c3f25758c16c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:1c:a7', 'vm-uuid': '8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:22 user nova-compute[75095]: INFO os_vif [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91')
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:22 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [{"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-2fac940f-34d2-401e-ad63-b60436b81807" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:23 user nova-compute[75095]: WARNING nova.compute.manager [req-e6ab0dfc-f07d-442f-bbff-9be9ae18e3e1 req-cd189382-b6d6-4b8b-bbe0-3d083b523394 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state active and task_state reboot_started_hard.
Nov 15 16:05:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:05:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance rebooted successfully.
Nov 15 16:05:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9383dc5b-2ae1-4ab4-81c5-fc6a6cb9a120 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.458s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:25 user nova-compute[75095]: WARNING nova.compute.manager [req-7fd2d26b-50c4-4c4d-aeb6-6b2d5fb66a5f req-493b8866-daaa-4e20-b1e0-a71b87cecf80 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state active and task_state None.
Nov 15 16:05:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:05:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:05:37 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8435MB free_disk=24.251537322998047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 2fac940f-34d2-401e-ad63-b60436b81807 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:05:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:39 user nova-compute[75095]: INFO nova.compute.manager [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Terminating instance
Nov 15 16:05:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-bbd9478d-7e77-42a6-a165-ed476d29f15e req-0edb924f-05d9-403f-a27f-50c87be497a4 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-unplugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Instance destroyed successfully.
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.objects.instance [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid 2fac940f-34d2-401e-ad63-b60436b81807 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1361455939',display_name='tempest-ServerRescueNegativeTestJSON-server-1361455939',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1361455939',id=39,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH16vexSVhF620msGDtWMag6BC8oQ3f6Ef/hJMnQ2BpKkMsdp37K7Dy9QN5mmlZ2H1yxg444oTk17ObM4mDUGwSA+whErFBkOYOWejIcffMyo3PzJ4Irx4OONjwrcDgUrw==',key_name='tempest-keypair-1716535491',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:01:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-dpa0cmvo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:03:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b373d886288b4895a2b41b26063db3fa',uuid=2fac940f-34d2-401e-ad63-b60436b81807,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "address": "fa:16:3e:62:b4:08", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85c7b24d-5d", "ovs_interfaceid": "85c7b24d-5d78-4a1a-904c-002d4a0276aa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG os_vif [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85c7b24d-5d, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=beb0730b-5609-41e5-99ea-cf953b865801) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:40 user nova-compute[75095]: INFO os_vif [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:b4:08,bridge_name='br-int',has_traffic_filtering=True,id=85c7b24d-5d78-4a1a-904c-002d4a0276aa,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85c7b24d-5d')
Nov 15 16:05:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Deleting instance files /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807_del
Nov 15 16:05:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Deletion of /opt/stack/data/nova/instances/2fac940f-34d2-401e-ad63-b60436b81807_del complete
Nov 15 16:05:40 user nova-compute[75095]: INFO nova.compute.manager [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 16:05:40 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:05:40 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:41 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Took 1.13 seconds to deallocate network for instance.
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-904b4195-c665-4f79-bbaf-3715ee344828 req-3e17d2f2-3329-4c23-b64e-f5f01b501cbe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-deleted-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:41 user nova-compute[75095]: INFO nova.compute.manager [req-904b4195-c665-4f79-bbaf-3715ee344828 req-3e17d2f2-3329-4c23-b64e-f5f01b501cbe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Neutron deleted interface 85c7b24d-5d78-4a1a-904c-002d4a0276aa; detaching it from the instance and deleting it from the info cache
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.network.neutron [req-904b4195-c665-4f79-bbaf-3715ee344828 req-3e17d2f2-3329-4c23-b64e-f5f01b501cbe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.compute.manager [req-904b4195-c665-4f79-bbaf-3715ee344828 req-3e17d2f2-3329-4c23-b64e-f5f01b501cbe service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Detach interface failed, port_id=85c7b24d-5d78-4a1a-904c-002d4a0276aa, reason: Instance 2fac940f-34d2-401e-ad63-b60436b81807 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:05:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:41 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Deleted allocations for instance 2fac940f-34d2-401e-ad63-b60436b81807
Nov 15 16:05:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-7b4bd497-f868-4898-b917-42ddc03d4087 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "2fac940f-34d2-401e-ad63-b60436b81807" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.259s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] Acquiring lock "2fac940f-34d2-401e-ad63-b60436b81807-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] Lock "2fac940f-34d2-401e-ad63-b60436b81807-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] No waiting events found dispatching network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:42 user nova-compute[75095]: WARNING nova.compute.manager [req-c175fab3-9c11-4f4c-8521-65461916662a req-f15820e6-f7a7-413f-93ab-bc88daeabdc1 service nova] [instance: 2fac940f-34d2-401e-ad63-b60436b81807] Received unexpected event network-vif-plugged-85c7b24d-5d78-4a1a-904c-002d4a0276aa for instance with vm_state deleted and task_state None.
Nov 15 16:05:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:49 user nova-compute[75095]: INFO nova.compute.manager [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Terminating instance
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-unplugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] No waiting events found dispatching network-vif-unplugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-eef6d344-e5f4-4f98-aa40-26e3e83074e2 req-7b94d9ab-aa85-4822-a2b2-49eb01a389ae service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-unplugged-9c0013c1-69f5-4691-b337-c8f77c87838f for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:05:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Instance destroyed successfully.
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lazy-loading 'resources' on Instance uuid 8590b8bb-61ea-4e65-826e-c8e0caf4620e {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2053381474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2053381474',id=13,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:45:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='146bfea92e9f4bf3b6996aac094f9e43',ramdisk_id='',reservation_id='r-n04nwudg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-146545434',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:47:18Z,user_data=None,user_id='e464dcfa23814b2798c8738730374dff',uuid=8590b8bb-61ea-4e65-826e-c8e0caf4620e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converting VIF {"id": "9c0013c1-69f5-4691-b337-c8f77c87838f", "address": "fa:16:3e:5d:02:e9", "network": {"id": "b56f08e8-cb96-4f0c-97c3-7eb33139fac2", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1529267076-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "146bfea92e9f4bf3b6996aac094f9e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c0013c1-69", "ovs_interfaceid": "9c0013c1-69f5-4691-b337-c8f77c87838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG os_vif [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c0013c1-69, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=513b7b2f-9906-4074-a04c-c82a89757b1f) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:49 user nova-compute[75095]: INFO os_vif [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:e9,bridge_name='br-int',has_traffic_filtering=True,id=9c0013c1-69f5-4691-b337-c8f77c87838f,network=Network(b56f08e8-cb96-4f0c-97c3-7eb33139fac2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c0013c1-69')
Nov 15 16:05:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Deleting instance files /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e_del
Nov 15 16:05:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Deletion of /opt/stack/data/nova/instances/8590b8bb-61ea-4e65-826e-c8e0caf4620e_del complete
Nov 15 16:05:49 user nova-compute[75095]: INFO nova.compute.manager [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 15 16:05:49 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:05:49 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:50 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Took 0.49 seconds to deallocate network for instance.
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-dab3eae3-5de9-4487-aa7e-c593d3ab276c req-2bcdb39c-c295-43ae-ab9f-60b10cd704e9 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-deleted-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:50 user nova-compute[75095]: INFO nova.compute.manager [req-dab3eae3-5de9-4487-aa7e-c593d3ab276c req-2bcdb39c-c295-43ae-ab9f-60b10cd704e9 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Neutron deleted interface 9c0013c1-69f5-4691-b337-c8f77c87838f; detaching it from the instance and deleting it from the info cache
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-dab3eae3-5de9-4487-aa7e-c593d3ab276c req-2bcdb39c-c295-43ae-ab9f-60b10cd704e9 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-dab3eae3-5de9-4487-aa7e-c593d3ab276c req-2bcdb39c-c295-43ae-ab9f-60b10cd704e9 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Detach interface failed, port_id=9c0013c1-69f5-4691-b337-c8f77c87838f, reason: Instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:50 user nova-compute[75095]: INFO nova.compute.manager [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Unshelving
Nov 15 16:05:50 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Deleted allocations for instance 8590b8bb-61ea-4e65-826e-c8e0caf4620e
Nov 15 16:05:50 user nova-compute[75095]: INFO nova.virt.block_device [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Booting with volume 206897b2-df7c-4730-a718-8d9d924e2d3e at /dev/vdc
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bbb040e7-2014-48c4-b6e4-fa25c7bf8bbd tempest-ServerBootFromVolumeStableRescueTest-146545434 tempest-ServerBootFromVolumeStableRescueTest-146545434-project-member] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7929925b-43e9-42ed-9add-0f071608b53a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c77e706-b7b6-4cf0-9cad-8da3a8bbf0e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b361e-84c4-48f0-8a92-d9de3766526a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f3c8b-01d3-42af-86e3-a3b16baa0ee8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:05:50 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:05:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914ecba-8e90-4d67-97c9-47e6a13b36b8]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:05:50 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating existing volume attachment record: 9b25cf03-130f-481e-af94-908c4a474edf {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:05:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] Acquiring lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] Lock "8590b8bb-61ea-4e65-826e-c8e0caf4620e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] No waiting events found dispatching network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:05:51 user nova-compute[75095]: WARNING nova.compute.manager [req-3fd0a703-0e05-4c5a-a9cd-3fc3a9ea2d6c req-7fc2b693-6532-4011-b60f-bcd4742b7615 service nova] [instance: 8590b8bb-61ea-4e65-826e-c8e0caf4620e] Received unexpected event network-vif-plugged-9c0013c1-69f5-4691-b337-c8f77c87838f for instance with vm_state deleted and task_state None.
Nov 15 16:05:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_requests' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'numa_topology' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:05:55 user nova-compute[75095]: INFO nova.compute.claims [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Claim successful on node user
Nov 15 16:05:55 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:05:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:55 user nova-compute[75095]: INFO nova.network.neutron [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating port c72bac14-43d1-4cc4-beaa-786f2a8e0616 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing instance network info cache due to event network-changed-c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:05:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:05:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Creating image(s)
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Refreshing network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG nova.objects.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.part --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG nova.virt.images [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] fed3aee9-3b77-42a3-b312-61f00eb49e2a was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.part /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updated VIF entry in instance network info cache for port c72bac14-43d1-4cc4-beaa-786f2a8e0616. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebc6fd0c-0412-4b59-b66b-f428f2d4b677 req-18ece388-7b32-4168-815a-d46e9707af80 service nova] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.part /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.converted" returned: 0 in 0.357s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.725s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:05:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b,backing_fmt=raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b,backing_fmt=raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk 1073741824" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "13d8667b26c72a70d1629bb00b2ecbabf6e50e6b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'migration_context' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG nova.objects.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:05:59 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Rebasing disk image.
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:05:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 -F raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 -F raw /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk" returned: 0 in 2.027s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Ensure instance console log exists: /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start _get_guest_xml network_info=[{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='396eee16a59a01f9c7e184b4e2442e37',container_format='bare',created_at=2023-11-15T16:03:58Z,direct_url=<?>,disk_format='qcow2',id=fed3aee9-3b77-42a3-b312-61f00eb49e2a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-388591464-shelved',owner='61d11880351b4cb6b30085b160c4a460',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T16:04:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'attachment_id': '9b25cf03-130f-481e-af94-908c4a474edf', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JDhwuBjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac', 'attached_at': '', 'detached_at': '', 'volume_id': '206897b2-df7c-4730-a718-8d9d924e2d3e', 'serial': '206897b2-df7c-4730-a718-8d9d924e2d3e'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:06:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='396eee16a59a01f9c7e184b4e2442e37',container_format='bare',created_at=2023-11-15T16:03:58Z,direct_url=<?>,disk_format='qcow2',id=fed3aee9-3b77-42a3-b312-61f00eb49e2a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-388591464-shelved',owner='61d11880351b4cb6b30085b160c4a460',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T16:04:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.objects.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JDhwuBjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:06:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:06:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:06:01 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3ea73-00fb-4221-a533-772ba4cae14a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:06:01 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fb2cd2-d9ca-4320-9d69-a0d1d012da34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e] added
Nov 15 16:06:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc713987-e876-4b96-a71a-f8fc6fbac753]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[93700743-e25f-4512-91fe-da07dfc14abf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JDhwuBjR {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JDhwuBjR" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[36726b2a-914e-4b11-9abd-cd79befc736e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JDhwuBjR'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec8e43-a7df-47db-a28b-8ca6daa12063]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03447c64-a634-4f7b-a573-b88a019fbca8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:06:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:06:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:06:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[066aefa6-c1bc-4398-baf1-4ac7fac23f0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260]
Nov 15 16:06:02 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260] successful.
Nov 15 16:06:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291e73b-2d0e-4caf-a64a-f9db4bdb9bed]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0104f62-f658-458f-9bd3-0bd54ede7c50]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:06:02 user nova-compute[75095]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:06:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:06:02 user nova-compute[75095]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:06:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9507767f-190c-4be7-96fc-a2d87c30f315]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:06:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JDhwuBjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23530346430363266', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530346430363266', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='fed3aee9-3b77-42a3-b312-61f00eb49e2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1521200829',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:04:01.932957',shelved_host='user',shelved_image_id='fed3aee9-3b77-42a3-b312-61f00eb49e2a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_devices' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.objects.base [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:06:03 user nova-compute[75095]:   <uuid>1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</uuid>
Nov 15 16:06:03 user nova-compute[75095]:   <name>instance-00000029</name>
Nov 15 16:06:03 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:06:03 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:06:03 user nova-compute[75095]:   <metadata>
Nov 15 16:06:03 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:06:03 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-388591464</nova:name>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:06:01</nova:creationTime>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:06:03 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:06:03 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:owner>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:user uuid="8bac844ae1f345e79e89acb0cfc8c4d8">tempest-AttachVolumeShelveTestJSON-1599642998-project-member</nova:user>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:project uuid="61d11880351b4cb6b30085b160c4a460">tempest-AttachVolumeShelveTestJSON-1599642998</nova:project>
Nov 15 16:06:03 user nova-compute[75095]:       </nova:owner>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:root type="image" uuid="fed3aee9-3b77-42a3-b312-61f00eb49e2a"/>
Nov 15 16:06:03 user nova-compute[75095]:       <nova:ports>
Nov 15 16:06:03 user nova-compute[75095]:         <nova:port uuid="c72bac14-43d1-4cc4-beaa-786f2a8e0616">
Nov 15 16:06:03 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 16:06:03 user nova-compute[75095]:         </nova:port>
Nov 15 16:06:03 user nova-compute[75095]:       </nova:ports>
Nov 15 16:06:03 user nova-compute[75095]:     </nova:instance>
Nov 15 16:06:03 user nova-compute[75095]:   </metadata>
Nov 15 16:06:03 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:06:03 user nova-compute[75095]:     <system>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="serial">1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</entry>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="uuid">1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac</entry>
Nov 15 16:06:03 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:06:03 user nova-compute[75095]:     </system>
Nov 15 16:06:03 user nova-compute[75095]:   </sysinfo>
Nov 15 16:06:03 user nova-compute[75095]:   <os>
Nov 15 16:06:03 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:06:03 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:06:03 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:06:03 user nova-compute[75095]:   </os>
Nov 15 16:06:03 user nova-compute[75095]:   <features>
Nov 15 16:06:03 user nova-compute[75095]:     <acpi/>
Nov 15 16:06:03 user nova-compute[75095]:     <apic/>
Nov 15 16:06:03 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:06:03 user nova-compute[75095]:   </features>
Nov 15 16:06:03 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:06:03 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:06:03 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:06:03 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:06:03 user nova-compute[75095]:   </clock>
Nov 15 16:06:03 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:06:03 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:06:03 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:06:03 user nova-compute[75095]:   </cpu>
Nov 15 16:06:03 user nova-compute[75095]:   <devices>
Nov 15 16:06:03 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:06:03 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:06:03 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk"/>
Nov 15 16:06:03 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:06:03 user nova-compute[75095]:     </disk>
Nov 15 16:06:03 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:06:03 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:06:03 user nova-compute[75095]:       <source dev="/dev/sdc"/>
Nov 15 16:06:03 user nova-compute[75095]:       <target dev="vdc" bus="virtio"/>
Nov 15 16:06:03 user nova-compute[75095]:       <serial>206897b2-df7c-4730-a718-8d9d924e2d3e</serial>
Nov 15 16:06:03 user nova-compute[75095]:     </disk>
Nov 15 16:06:03 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:06:03 user nova-compute[75095]:       <mac address="fa:16:3e:c4:a2:2a"/>
Nov 15 16:06:03 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:06:03 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:06:03 user nova-compute[75095]:       <target dev="tapc72bac14-43"/>
Nov 15 16:06:03 user nova-compute[75095]:     </interface>
Nov 15 16:06:03 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:06:03 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/console.log" append="off"/>
Nov 15 16:06:03 user nova-compute[75095]:     </serial>
Nov 15 16:06:03 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:06:03 user nova-compute[75095]:     <video>
Nov 15 16:06:03 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:06:03 user nova-compute[75095]:     </video>
Nov 15 16:06:03 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:06:03 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:06:03 user nova-compute[75095]:     </rng>
Nov 15 16:06:03 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:06:03 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:06:03 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:06:03 user nova-compute[75095]:     </memballoon>
Nov 15 16:06:03 user nova-compute[75095]:   </devices>
Nov 15 16:06:03 user nova-compute[75095]: </domain>
Nov 15 16:06:03 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='fed3aee9-3b77-42a3-b312-61f00eb49e2a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1521200829',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:02:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:04:01.932957',shelved_host='user',shelved_image_id='fed3aee9-3b77-42a3-b312-61f00eb49e2a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG os_vif [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed23f25c-64ac-5bfc-865b-342f1d331f60', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc72bac14-43, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc72bac14-43, col_values=(('qos', UUID('3bf5e11d-3276-463c-9605-b092fb0d4037')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc72bac14-43, col_values=(('external_ids', {'iface-id': 'c72bac14-43d1-4cc4-beaa-786f2a8e0616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:a2:2a', 'vm-uuid': '1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:03 user nova-compute[75095]: INFO os_vif [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43')
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:06:03 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No VIF found with MAC fa:16:3e:c4:a2:2a, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:04 user nova-compute[75095]: WARNING nova.compute.manager [req-4e87af38-7778-4594-b00b-3bea83e32f74 req-3802b038-f448-4006-afbe-a0b5096ce0d6 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 16:06:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:06:06 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance spawned successfully.
Nov 15 16:06:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:06 user nova-compute[75095]: WARNING nova.compute.manager [req-8beba1b7-42c6-4e4e-b781-434d4a5e6bd7 req-61dacac0-86d3-4b0f-9ae4-bb5a0cfb9f32 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 16:06:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:06:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-1c10c8d3-3231-4cce-8c12-15e41b459d39 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.422s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:06:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:06:24 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [{"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:06:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-aad21504-a43c-4451-8b5b-90ac2a8fc3a5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:06:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:06:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:06:32 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:35 user nova-compute[75095]: INFO nova.compute.manager [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Terminating instance
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-ebce2449-5a9b-499d-afcc-f733673fc664 req-41752dca-3ee2-4fb2-983d-e2d77b95ee48 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-unplugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:06:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Instance destroyed successfully.
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.objects.instance [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-486487011',display_name='tempest-ServerRescueNegativeTestJSON-server-486487011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-486487011',id=27,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:52:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-3chxgaqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:52:35Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "cc369ea8-4685-43ea-b690-07b025a48169", "address": "fa:16:3e:26:93:5e", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc369ea8-46", "ovs_interfaceid": "cc369ea8-4685-43ea-b690-07b025a48169", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG os_vif [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc369ea8-46, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=54f76fa4-a3b8-4edf-974d-9cc352a428ae) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:35 user nova-compute[75095]: INFO os_vif [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:93:5e,bridge_name='br-int',has_traffic_filtering=True,id=cc369ea8-4685-43ea-b690-07b025a48169,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc369ea8-46')
Nov 15 16:06:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Deleting instance files /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1_del
Nov 15 16:06:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Deletion of /opt/stack/data/nova/instances/bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1_del complete
Nov 15 16:06:36 user nova-compute[75095]: INFO nova.compute.manager [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Took 0.75 seconds to destroy the instance on the hypervisor.
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:06:36 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Took 0.38 seconds to deallocate network for instance.
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:36 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Deleted allocations for instance bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-768493d0-f54f-41c3-80cd-4cdccf1ed70a tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.548s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] Acquiring lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] Lock "bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] No waiting events found dispatching network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:37 user nova-compute[75095]: WARNING nova.compute.manager [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received unexpected event network-vif-plugged-cc369ea8-4685-43ea-b690-07b025a48169 for instance with vm_state deleted and task_state None.
Nov 15 16:06:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-48ef9c5d-2117-4ad1-a6cb-cf284bd3afbd req-5a43b1aa-0bf0-4695-bf24-b8d9537ef183 service nova] [instance: bb47c7a0-9b2c-451c-b3a0-7b4dbe905ee1] Received event network-vif-deleted-cc369ea8-4685-43ea-b690-07b025a48169 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:06:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:38 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8638MB free_disk=24.406055450439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:06:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:06:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:06:51 user nova-compute[75095]: INFO nova.compute.claims [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Claim successful on node user
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.308s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:06:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.policy [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'affac16301c14d9bb758222765b5f600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b8acac89af43a2a6c63b27f6d56528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:06:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Creating image(s)
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk 1073741824" returned: 0 in 0.058s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Successfully created port: 01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Cannot resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Ensure instance console log exists: /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Successfully updated port: 01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-changed-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Refreshing instance network info cache due to event network-changed-01b9a48d-6824-42df-b799-8b229992efee. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.neutron [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance network_info: |[{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.neutron [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Refreshing network info cache for port 01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start _get_guest_xml network_info=[{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:06:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.objects.instance [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'pci_devices' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:06:53 user nova-compute[75095]:   <uuid>08918122-86d9-40c8-8a72-046aba3a3fc6</uuid>
Nov 15 16:06:53 user nova-compute[75095]:   <name>instance-0000002b</name>
Nov 15 16:06:53 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:06:53 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:06:53 user nova-compute[75095]:   <metadata>
Nov 15 16:06:53 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:06:53 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeTestJSON-server-697539317</nova:name>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:06:53</nova:creationTime>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:06:53 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:06:53 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:owner>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:user uuid="affac16301c14d9bb758222765b5f600">tempest-AttachVolumeTestJSON-640760510-project-member</nova:user>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:project uuid="56b8acac89af43a2a6c63b27f6d56528">tempest-AttachVolumeTestJSON-640760510</nova:project>
Nov 15 16:06:53 user nova-compute[75095]:       </nova:owner>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:06:53 user nova-compute[75095]:       <nova:ports>
Nov 15 16:06:53 user nova-compute[75095]:         <nova:port uuid="01b9a48d-6824-42df-b799-8b229992efee">
Nov 15 16:06:53 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 16:06:53 user nova-compute[75095]:         </nova:port>
Nov 15 16:06:53 user nova-compute[75095]:       </nova:ports>
Nov 15 16:06:53 user nova-compute[75095]:     </nova:instance>
Nov 15 16:06:53 user nova-compute[75095]:   </metadata>
Nov 15 16:06:53 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:06:53 user nova-compute[75095]:     <system>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="serial">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="uuid">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:06:53 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:06:53 user nova-compute[75095]:     </system>
Nov 15 16:06:53 user nova-compute[75095]:   </sysinfo>
Nov 15 16:06:53 user nova-compute[75095]:   <os>
Nov 15 16:06:53 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:06:53 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:06:53 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:06:53 user nova-compute[75095]:   </os>
Nov 15 16:06:53 user nova-compute[75095]:   <features>
Nov 15 16:06:53 user nova-compute[75095]:     <acpi/>
Nov 15 16:06:53 user nova-compute[75095]:     <apic/>
Nov 15 16:06:53 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:06:53 user nova-compute[75095]:   </features>
Nov 15 16:06:53 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:06:53 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:06:53 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:06:53 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:06:53 user nova-compute[75095]:   </clock>
Nov 15 16:06:53 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:06:53 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:06:53 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:06:53 user nova-compute[75095]:   </cpu>
Nov 15 16:06:53 user nova-compute[75095]:   <devices>
Nov 15 16:06:53 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:06:53 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:06:53 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk"/>
Nov 15 16:06:53 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:06:53 user nova-compute[75095]:     </disk>
Nov 15 16:06:53 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:06:53 user nova-compute[75095]:       <mac address="fa:16:3e:b5:79:da"/>
Nov 15 16:06:53 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:06:53 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:06:53 user nova-compute[75095]:       <target dev="tap01b9a48d-68"/>
Nov 15 16:06:53 user nova-compute[75095]:     </interface>
Nov 15 16:06:53 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:06:53 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/console.log" append="off"/>
Nov 15 16:06:53 user nova-compute[75095]:     </serial>
Nov 15 16:06:53 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:06:53 user nova-compute[75095]:     <video>
Nov 15 16:06:53 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:06:53 user nova-compute[75095]:     </video>
Nov 15 16:06:53 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:06:53 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:06:53 user nova-compute[75095]:     </rng>
Nov 15 16:06:53 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:06:53 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:06:53 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:06:53 user nova-compute[75095]:     </memballoon>
Nov 15 16:06:53 user nova-compute[75095]:   </devices>
Nov 15 16:06:53 user nova-compute[75095]: </domain>
Nov 15 16:06:53 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:06:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG os_vif [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e37dde8-caa3-51d5-969b-c4f3187ef3f5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b9a48d-68, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b9a48d-68, col_values=(('qos', UUID('9f45979a-2385-4d8a-bbd0-72237baae97f')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b9a48d-68, col_values=(('external_ids', {'iface-id': '01b9a48d-6824-42df-b799-8b229992efee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:79:da', 'vm-uuid': '08918122-86d9-40c8-8a72-046aba3a3fc6'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:06:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:53 user nova-compute[75095]: INFO os_vif [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:06:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:06:54 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No VIF found with MAC fa:16:3e:b5:79:da, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:06:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updated VIF entry in instance network info cache for port 01b9a48d-6824-42df-b799-8b229992efee. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:06:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:06:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-26ae74a2-7de6-4bc7-a16a-c03c39019e5e req-9a24882f-6cbb-48c2-89bc-0eded0cf3016 service nova] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:06:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:55 user nova-compute[75095]: WARNING nova.compute.manager [req-4d4013cb-fe3e-462b-890f-9f8aa6af7f2f req-a7e44049-deac-4406-a000-cd96696aa3d5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state building and task_state spawning.
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:06:57 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance spawned successfully.
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:06:57 user nova-compute[75095]: WARNING nova.compute.manager [req-d6480d71-6193-4f36-ae99-57e86a7dea52 req-1eea261e-a440-4259-ae09-d776b0e0b3c5 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state building and task_state spawning.
Nov 15 16:06:57 user nova-compute[75095]: INFO nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 16:06:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:06:57 user nova-compute[75095]: INFO nova.compute.manager [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Took 6.31 seconds to build instance.
Nov 15 16:06:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-bdba7769-0bf6-4add-8f8b-bdca3d7262b0 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.427s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:06:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:06:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG nova.compute.manager [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing instance network info cache due to event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated VIF entry in instance network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG nova.network.neutron [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:07:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fe597be2-5365-4993-891d-302671f29c28 req-ffeb8eac-4dc1-408b-9e80-cd0506d254aa service nova] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:07:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:11 user nova-compute[75095]: INFO nova.compute.manager [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Detaching volume 8cd3f4c2-0429-4496-9e95-bf7f1829035c
Nov 15 16:07:11 user nova-compute[75095]: INFO nova.virt.block_device [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Attempting to driver detach volume 8cd3f4c2-0429-4496-9e95-bf7f1829035c from mountpoint /dev/vdb
Nov 15 16:07:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Attempting to detach device vdb from instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:07:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:07:11 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:07:11 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:07:11 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:07:11 user nova-compute[75095]:   <serial>8cd3f4c2-0429-4496-9e95-bf7f1829035c</serial>
Nov 15 16:07:11 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:07:11 user nova-compute[75095]: </disk>
Nov 15 16:07:11 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:07:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully detached device vdb from instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed from the persistent domain config.
Nov 15 16:07:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:07:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:07:11 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:07:11 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:07:11 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:07:11 user nova-compute[75095]:   <serial>8cd3f4c2-0429-4496-9e95-bf7f1829035c</serial>
Nov 15 16:07:11 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:07:11 user nova-compute[75095]: </disk>
Nov 15 16:07:11 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:07:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing instance network info cache due to event network-changed-4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Refreshing network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated VIF entry in instance network info cache for port 4ac10c93-9173-477e-ad4c-c3f25758c16c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG nova.network.neutron [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:07:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-779bb372-190f-4be9-84b2-6639663ed29e req-69763efc-fe65-4194-be0a-207f2bd6bf77 service nova] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:07:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:07:24 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [{"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:25 user nova-compute[75095]: INFO nova.compute.manager [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Terminating instance
Nov 15 16:07:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-d9791f8b-ee77-4889-986e-f99e228d5c32 req-9c2d5bb9-ed12-415d-9172-999b23319f6f service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-unplugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Instance destroyed successfully.
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lazy-loading 'resources' on Instance uuid aad21504-a43c-4451-8b5b-90ac2a8fc3a5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T15:50:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1894338793',display_name='tempest-ServerRescueNegativeTestJSON-server-1894338793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1894338793',id=26,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T15:55:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0cf29264b1f4e38982c483eed3bf857',ramdisk_id='',reservation_id='r-wzgee21s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1926967793',owner_user_name='tempest-ServerRescueNegativeTestJSON-1926967793-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T15:57:17Z,user_data=None,user_id='b373d886288b4895a2b41b26063db3fa',uuid=aad21504-a43c-4451-8b5b-90ac2a8fc3a5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converting VIF {"id": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "address": "fa:16:3e:64:3a:ce", "network": {"id": "914feca1-83db-43ea-b556-3febe7e1806c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-15760348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0cf29264b1f4e38982c483eed3bf857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e5dc9c-62", "ovs_interfaceid": "24e5dc9c-6245-497d-8a25-1b5f0f24fbb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG os_vif [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e5dc9c-62, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=203f5e3a-420a-44ae-8473-44f5e04afe06) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:07:26 user nova-compute[75095]: INFO os_vif [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:64:3a:ce,bridge_name='br-int',has_traffic_filtering=True,id=24e5dc9c-6245-497d-8a25-1b5f0f24fbb2,network=Network(914feca1-83db-43ea-b556-3febe7e1806c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24e5dc9c-62')
Nov 15 16:07:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Deleting instance files /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5_del
Nov 15 16:07:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Deletion of /opt/stack/data/nova/instances/aad21504-a43c-4451-8b5b-90ac2a8fc3a5_del complete
Nov 15 16:07:26 user nova-compute[75095]: INFO nova.compute.manager [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 16:07:26 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:07:26 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:07:27 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:07:27 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Took 0.46 seconds to deallocate network for instance.
Nov 15 16:07:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:27 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:07:27 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:07:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:27 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Deleted allocations for instance aad21504-a43c-4451-8b5b-90ac2a8fc3a5
Nov 15 16:07:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d34ea56b-44c6-4794-8929-b88d711ab842 tempest-ServerRescueNegativeTestJSON-1926967793 tempest-ServerRescueNegativeTestJSON-1926967793-project-member] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.459s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:07:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] Acquiring lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] Lock "aad21504-a43c-4451-8b5b-90ac2a8fc3a5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] No waiting events found dispatching network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:07:28 user nova-compute[75095]: WARNING nova.compute.manager [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received unexpected event network-vif-plugged-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 for instance with vm_state deleted and task_state None.
Nov 15 16:07:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-fbdb1193-9689-4d7c-908e-7117f719e3c5 req-8f2a1af2-8d38-45f3-b425-8fe970144938 service nova] [instance: aad21504-a43c-4451-8b5b-90ac2a8fc3a5] Received event network-vif-deleted-24e5dc9c-6245-497d-8a25-1b5f0f24fbb2 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:07:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:31 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed is timed out.
Nov 15 16:07:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully detached device vdb from instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed from the live domain config.
Nov 15 16:07:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Gnyevmxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:07:31 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1136cbaa-fd3e-4b13-a748-14942c4a8c7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:07:31 user nova-compute[75095]: No targets found.
Nov 15 16:07:31 user nova-compute[75095]: iSNS:
Nov 15 16:07:31 user nova-compute[75095]: No targets found.
Nov 15 16:07:31 user nova-compute[75095]: STATIC:
Nov 15 16:07:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e
Nov 15 16:07:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:07:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:07:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c
Nov 15 16:07:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:07:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:07:31 user nova-compute[75095]: FIRMWARE:
Nov 15 16:07:31 user nova-compute[75095]: No targets found.
Nov 15 16:07:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:07:31 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:07:31 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af67db-17c6-4164-aa74-cb89d1603809]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e40bb6-aeac-44da-b507-92d9b6bcafb2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:07:31 user nova-compute[75095]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:07:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c (non-flash)
Nov 15 16:07:31 user nova-compute[75095]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:07:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c45f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bd85b9-fe3d-4648-a7bf-68252df13d14]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[750b7583-579f-4209-81b0-e116fb87f161]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d878957-3e9a-4d01-b751-08a528f44265]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c0ddc-4cba-452e-a363-dda4bf94eebd]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.039s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45acc55b-6fc9-4c99-bad5-1509dfc7e1b8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:07:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a25f52a-b70b-4a93-9dd9-409bed4fee6a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260]
Nov 15 16:07:32 user nova-compute[75095]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c, portal: 172.16.0.220,3260] successful.
Nov 15 16:07:32 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cd3f4c2-0429-4496-9e95-bf7f1829035c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c13eb7d-a50b-44f0-b8e0-313283443b69]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== disconnect_volume: return (305ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:07:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-97d541a9-98d5-4534-9b72-b35d3fc2e664 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.592s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:07:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:07:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:07:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:07:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=24.395782470703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:07:40 user nova-compute[75095]: INFO nova.compute.manager [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Detaching volume 206897b2-df7c-4730-a718-8d9d924e2d3e
Nov 15 16:07:40 user nova-compute[75095]: INFO nova.virt.block_device [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Attempting to driver detach volume 206897b2-df7c-4730-a718-8d9d924e2d3e from mountpoint /dev/vdc
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Attempting to detach device vdc from instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:07:40 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:07:40 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:07:40 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 16:07:40 user nova-compute[75095]:   <serial>206897b2-df7c-4730-a718-8d9d924e2d3e</serial>
Nov 15 16:07:40 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:07:40 user nova-compute[75095]: </disk>
Nov 15 16:07:40 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:07:40 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully detached device vdc from instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac from the persistent domain config.
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:07:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:07:40 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:07:40 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:07:40 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 16:07:40 user nova-compute[75095]:   <serial>206897b2-df7c-4730-a718-8d9d924e2d3e</serial>
Nov 15 16:07:40 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:07:40 user nova-compute[75095]: </disk>
Nov 15 16:07:40 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:07:41 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:07:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:07:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:07:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:07:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:01 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac is timed out.
Nov 15 16:08:01 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully detached device vdc from instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac from the live domain config.
Nov 15 16:08:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JDhwuBjR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:08:01 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9d2d60-6e49-42be-a02f-2c60e8ef8b2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:08:01 user nova-compute[75095]: No targets found.
Nov 15 16:08:01 user nova-compute[75095]: iSNS:
Nov 15 16:08:01 user nova-compute[75095]: No targets found.
Nov 15 16:08:01 user nova-compute[75095]: STATIC:
Nov 15 16:08:01 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e
Nov 15 16:08:01 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:08:01 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:08:01 user nova-compute[75095]: FIRMWARE:
Nov 15 16:08:01 user nova-compute[75095]: No targets found.
Nov 15 16:08:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:08:01 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:08:01 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a5877-a85d-4c56-9eac-e126f7bc8402]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4448aa-3299-4d68-bd10-c159f58a45a0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:08:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e (non-flash)
Nov 15 16:08:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c195b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15d5bc5-84e7-4d2a-8ed6-14f6a5ca2b90]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa91ddf-b117-40a2-97c2-637a72e2d591]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61348eb-1986-4cd4-82b0-cb987fc7ebd5]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eccefe2-2435-42b5-a584-75eb12541e5f]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5324230b-897b-4f18-96d8-3bd9b72ebfcf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91df69e0-2605-4d77-a099-8e19c408386c]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260]
Nov 15 16:08:01 user nova-compute[75095]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e, portal: 172.16.0.220,3260] successful.
Nov 15 16:08:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:206897b2-df7c-4730-a718-8d9d924e2d3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[693ff161-2d10-4295-8652-606401e6ebe7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] <== disconnect_volume: return (285ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:08:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:08:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'flavor' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-000caf64-e230-4c69-a386-b7ebf1db57c6 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.741s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:03 user nova-compute[75095]: INFO nova.compute.manager [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Terminating instance
Nov 15 16:08:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-27321450-7932-4776-ad9a-fd6133f9e560 req-ad5db79f-874f-43e1-9258-4a951e4521bb service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-unplugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:08:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Instance destroyed successfully.
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.objects.instance [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'resources' on Instance uuid 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:03:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-266246347',display_name='tempest-TestMinimumBasicScenario-server-266246347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-266246347',id=42,image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL8qG1vWd1Yq2fLG6Thicn78jw3K2KsCupeeIMbbhj8w8vpyW9VNt/OwTvmgflLf38K14h2kk+qyqQy0CMXSuxhUD/JRlZ+xUamAeQPeGj45njCIcIgC5+vS0HC8Zf750A==',key_name='tempest-TestMinimumBasicScenario-1532973681',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:03:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-18wykr61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='bcb00b7d-95fa-4eb7-a88f-27905055325e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:05:26Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "address": "fa:16:3e:8f:1c:a7", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ac10c93-91", "ovs_interfaceid": "4ac10c93-9173-477e-ad4c-c3f25758c16c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG os_vif [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ac10c93-91, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ba2304d-7207-438f-9781-8d37ce3b3cc3) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:04 user nova-compute[75095]: INFO os_vif [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:1c:a7,bridge_name='br-int',has_traffic_filtering=True,id=4ac10c93-9173-477e-ad4c-c3f25758c16c,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ac10c93-91')
Nov 15 16:08:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Deleting instance files /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed_del
Nov 15 16:08:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Deletion of /opt/stack/data/nova/instances/8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed_del complete
Nov 15 16:08:04 user nova-compute[75095]: INFO nova.compute.manager [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 15 16:08:04 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:08:04 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:08:05 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:05 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Took 0.47 seconds to deallocate network for instance.
Nov 15 16:08:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:08:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:08:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:05 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Deleted allocations for instance 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed
Nov 15 16:08:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-66452dc1-5c8d-4f71-a399-adcd8fbe0f9e tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.979s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] Acquiring lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] Lock "8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] No waiting events found dispatching network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:06 user nova-compute[75095]: WARNING nova.compute.manager [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received unexpected event network-vif-plugged-4ac10c93-9173-477e-ad4c-c3f25758c16c for instance with vm_state deleted and task_state None.
Nov 15 16:08:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-572032b8-00f9-4692-aa32-10a838b4f5c4 req-c6592563-b32f-42d6-afe7-f134b2554487 service nova] [instance: 8f195fc9-b1f3-49f4-a3d6-fd238fbc53ed] Received event network-vif-deleted-4ac10c93-9173-477e-ad4c-c3f25758c16c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:08:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:08:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:26 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:08:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:08:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:08:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:08:27 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [{"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:08:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:08:29 user nova-compute[75095]: INFO nova.compute.claims [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Claim successful on node user
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:08:29 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.policy [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c77613061a8c475087e49aedec4a9bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228614fdcc87477786a1c9c97b366eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:08:29 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Creating image(s)
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk 1073741824" returned: 0 in 0.051s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Successfully created port: 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.194s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Cannot resize image /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Ensure instance console log exists: /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Successfully updated port: 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquired lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:08:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-changed-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Refreshing instance network info cache due to event network-changed-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] Acquiring lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:31 user nova-compute[75095]: INFO nova.compute.manager [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Terminating instance
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Releasing lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Instance network_info: |[{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] Acquired lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Refreshing network info cache for port 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Start _get_guest_xml network_info=[{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:08:31 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:08:31 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-869441188',display_name='tempest-AttachVolumeNegativeTest-server-869441188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-869441188',id=44,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLYeg6CbbN7oiY6VHDchSusoQ17FUyCObvBUtj4MRZsC37/9Ev6bX78CHos8atCFsz/E4Q4s2+P66epgkPW/TnCTa2qmPQ40fiJQDAVx+xvrvzBgGQ8kPOsaYWPC4EYQ==',key_name='tempest-keypair-1023059094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-o7azntrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8fdc2842-a28c-4eaa-95c7-57c43dd864ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.objects.instance [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:08:31 user nova-compute[75095]:   <uuid>8fdc2842-a28c-4eaa-95c7-57c43dd864ea</uuid>
Nov 15 16:08:31 user nova-compute[75095]:   <name>instance-0000002c</name>
Nov 15 16:08:31 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:08:31 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:08:31 user nova-compute[75095]:   <metadata>
Nov 15 16:08:31 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:08:31 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeNegativeTest-server-869441188</nova:name>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:08:31</nova:creationTime>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:08:31 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:08:31 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:owner>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:user uuid="c77613061a8c475087e49aedec4a9bd0">tempest-AttachVolumeNegativeTest-677596313-project-member</nova:user>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:project uuid="228614fdcc87477786a1c9c97b366eeb">tempest-AttachVolumeNegativeTest-677596313</nova:project>
Nov 15 16:08:31 user nova-compute[75095]:       </nova:owner>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:08:31 user nova-compute[75095]:       <nova:ports>
Nov 15 16:08:31 user nova-compute[75095]:         <nova:port uuid="7c1f2a50-0b97-4c68-becf-46f0e0c6aa25">
Nov 15 16:08:31 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 16:08:31 user nova-compute[75095]:         </nova:port>
Nov 15 16:08:31 user nova-compute[75095]:       </nova:ports>
Nov 15 16:08:31 user nova-compute[75095]:     </nova:instance>
Nov 15 16:08:31 user nova-compute[75095]:   </metadata>
Nov 15 16:08:31 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:08:31 user nova-compute[75095]:     <system>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="serial">8fdc2842-a28c-4eaa-95c7-57c43dd864ea</entry>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="uuid">8fdc2842-a28c-4eaa-95c7-57c43dd864ea</entry>
Nov 15 16:08:31 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:08:31 user nova-compute[75095]:     </system>
Nov 15 16:08:31 user nova-compute[75095]:   </sysinfo>
Nov 15 16:08:31 user nova-compute[75095]:   <os>
Nov 15 16:08:31 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:08:31 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:08:31 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:08:31 user nova-compute[75095]:   </os>
Nov 15 16:08:31 user nova-compute[75095]:   <features>
Nov 15 16:08:31 user nova-compute[75095]:     <acpi/>
Nov 15 16:08:31 user nova-compute[75095]:     <apic/>
Nov 15 16:08:31 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:08:31 user nova-compute[75095]:   </features>
Nov 15 16:08:31 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:08:31 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:08:31 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:08:31 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:08:31 user nova-compute[75095]:   </clock>
Nov 15 16:08:31 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:08:31 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:08:31 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:08:31 user nova-compute[75095]:   </cpu>
Nov 15 16:08:31 user nova-compute[75095]:   <devices>
Nov 15 16:08:31 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:08:31 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:08:31 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk"/>
Nov 15 16:08:31 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:08:31 user nova-compute[75095]:     </disk>
Nov 15 16:08:31 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:08:31 user nova-compute[75095]:       <mac address="fa:16:3e:20:38:ab"/>
Nov 15 16:08:31 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:08:31 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:08:31 user nova-compute[75095]:       <target dev="tap7c1f2a50-0b"/>
Nov 15 16:08:31 user nova-compute[75095]:     </interface>
Nov 15 16:08:31 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:08:31 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/console.log" append="off"/>
Nov 15 16:08:31 user nova-compute[75095]:     </serial>
Nov 15 16:08:31 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:08:31 user nova-compute[75095]:     <video>
Nov 15 16:08:31 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:08:31 user nova-compute[75095]:     </video>
Nov 15 16:08:31 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:08:31 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:08:31 user nova-compute[75095]:     </rng>
Nov 15 16:08:31 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:08:31 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:08:31 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:08:31 user nova-compute[75095]:     </memballoon>
Nov 15 16:08:31 user nova-compute[75095]:   </devices>
Nov 15 16:08:31 user nova-compute[75095]: </domain>
Nov 15 16:08:31 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-869441188',display_name='tempest-AttachVolumeNegativeTest-server-869441188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-869441188',id=44,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLYeg6CbbN7oiY6VHDchSusoQ17FUyCObvBUtj4MRZsC37/9Ev6bX78CHos8atCFsz/E4Q4s2+P66epgkPW/TnCTa2qmPQ40fiJQDAVx+xvrvzBgGQ8kPOsaYWPC4EYQ==',key_name='tempest-keypair-1023059094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-o7azntrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:08:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8fdc2842-a28c-4eaa-95c7-57c43dd864ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG os_vif [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ced647f0-4523-5871-9564-7e5135d25bd3', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c1f2a50-0b, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c1f2a50-0b, col_values=(('qos', UUID('008ce679-91ab-44d9-af74-ed781e216594')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c1f2a50-0b, col_values=(('external_ids', {'iface-id': '7c1f2a50-0b97-4c68-becf-46f0e0c6aa25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:38:ab', 'vm-uuid': '8fdc2842-a28c-4eaa-95c7-57c43dd864ea'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:31 user nova-compute[75095]: INFO os_vif [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b')
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:20:38:ab, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updated VIF entry in instance network info cache for port 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2760ee45-0237-42ec-a02d-39fe15c1c936 req-26e038b7-93e2-4e3d-baed-e177fd53cbb6 service nova] Releasing lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:08:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Instance destroyed successfully.
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'resources' on Instance uuid 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:02:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-388591464',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-388591464',id=41,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHBDJGYyfD1DBITBa/Hh25RKCW5SlVvxFT8lI0nijgCo3VtMKc27yI9I8JHX2lMtaWryHGhH51kQzW33mWQv+MwthKqYjYdxFi8GWPsj0s5v0ppEUJZrIfby0OtcGh0fQ==',key_name='tempest-keypair-1521200829',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-iemo5fie',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:06:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "address": "fa:16:3e:c4:a2:2a", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc72bac14-43", "ovs_interfaceid": "c72bac14-43d1-4cc4-beaa-786f2a8e0616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG os_vif [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc72bac14-43, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3bf5e11d-3276-463c-9605-b092fb0d4037) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:32 user nova-compute[75095]: INFO os_vif [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:a2:2a,bridge_name='br-int',has_traffic_filtering=True,id=c72bac14-43d1-4cc4-beaa-786f2a8e0616,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc72bac14-43')
Nov 15 16:08:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Deleting instance files /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac_del
Nov 15 16:08:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Deletion of /opt/stack/data/nova/instances/1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac_del complete
Nov 15 16:08:32 user nova-compute[75095]: INFO nova.compute.manager [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 16:08:32 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:08:32 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-unplugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Acquiring lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] No waiting events found dispatching network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:33 user nova-compute[75095]: WARNING nova.compute.manager [req-c99a3923-8a93-4b0a-9e71-3842f551a28b req-1c7e78ca-b02d-4dfd-9cb9-9a75359171d8 service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received unexpected event network-vif-plugged-c72bac14-43d1-4cc4-beaa-786f2a8e0616 for instance with vm_state active and task_state deleting.
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:33 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Took 0.60 seconds to deallocate network for instance.
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] No waiting events found dispatching network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:33 user nova-compute[75095]: WARNING nova.compute.manager [req-6ca02339-68a0-4fba-8f22-62b7e2b84f44 req-fc31f674-94ab-4467-a0f2-ccc450b97b95 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received unexpected event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 for instance with vm_state building and task_state spawning.
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:33 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Deleted allocations for instance 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-64edfa2f-f49e-480b-bf7f-f33194bd88ca tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d4d1e7ff-71a0-43ff-95e0-fabb3d992dfb req-b3412811-ad9a-440f-ad4f-3558d81147be service nova] [instance: 1aaa9fb4-42ef-4e16-b9e9-d20f8ff57eac] Received event network-vif-deleted-c72bac14-43d1-4cc4-beaa-786f2a8e0616 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] No waiting events found dispatching network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:35 user nova-compute[75095]: WARNING nova.compute.manager [req-d1d1e852-e5dd-4bc6-a759-666d8fb23ba5 req-f9f0a894-d6dd-44cf-9fec-e632dc9b320e service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received unexpected event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 for instance with vm_state building and task_state spawning.
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:08:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Instance spawned successfully.
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:08:35 user nova-compute[75095]: INFO nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 15 16:08:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:08:35 user nova-compute[75095]: INFO nova.compute.manager [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Took 6.31 seconds to build instance.
Nov 15 16:08:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-6205cd3e-9658-4f36-b97d-3f37988908e9 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.406s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:08:40 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:08:40 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=24.448993682861328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:08:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-changed-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG nova.compute.manager [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Refreshing instance network info cache due to event network-changed-01b9a48d-6824-42df-b799-8b229992efee. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Refreshing network info cache for port 01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updated VIF entry in instance network info cache for port 01b9a48d-6824-42df-b799-8b229992efee. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG nova.network.neutron [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:08:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5d7618ad-3782-4222-b1dd-a82da8528759 req-c7d12efb-bec4-4c63-81a9-a99ad59b5bd4 service nova] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:44 user nova-compute[75095]: INFO nova.compute.manager [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Attaching volume fb140e19-04ed-46de-9e8d-0eb284acc8a6 to /dev/vdb
Nov 15 16:08:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.utils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0d5fe1-ea4d-45e0-adfb-ce1716847ee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f42abf2-8180-4e63-8422-ccbfda571d80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cb10e-4c31-4ee8-9854-8daa647a9231]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c001a68-f9d6-4cef-857e-9aa704ebc21f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:08:44 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:08:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b0292d-fec6-4916-9e0e-61d9edf155b7]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG os_brick.utils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:08:44 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating existing volume attachment record: 71672c00-e4a9-4930-9207-38594e29618f {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:08:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:08:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:08:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:08:48 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:08:48 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:08:48 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f501361f-2ab7-46de-b175-63999d5ddf06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:08:48 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a82c7f-75d4-41a3-b466-51016a53b3a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6] added
Nov 15 16:08:48 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e32c4-a24e-4375-94cf-05898da32c61]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d57384-a8e3-4882-a036-6ee8454207a4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbNCVzJn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbNCVzJn" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[584ad5dd-be37-431d-9078-c92449d8f4bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbNCVzJn'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[086eb167-2844-40a0-b3b7-c4f514694b38]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921666a-b603-410b-b8e5-653eee457b65]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:08:49 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:08:49 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:08:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:08:49 user nova-compute[75095]: 
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c784b7d-2d78-4c28-bc77-c77e121e00a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]
Nov 15 16:08:49 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.
Nov 15 16:08:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c619710e-c800-4078-882a-184a8ee0d67b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb0eae-0d75-4086-83af-61730f710cf2]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:08:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:08:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.232s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb689ee-c94e-4f4b-946a-adbd53ee218c]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:08:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.261s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '23433303138616531', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303138616531', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:08:50 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:08:50 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:08:50 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:08:50 user nova-compute[75095]:   <serial>fb140e19-04ed-46de-9e8d-0eb284acc8a6</serial>
Nov 15 16:08:50 user nova-compute[75095]: </disk>
Nov 15 16:08:50 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No VIF found with MAC fa:16:3e:b5:79:da, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:08:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9f0d0445-705f-4941-9147-16f235343df3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.469s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75095) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:51 user nova-compute[75095]: WARNING nova.compute.manager [req-6be445e3-fbd1-4138-a160-5b653405e33b req-b6661022-c618-4130-927c-853535b3e05c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state active and task_state powering-off.
Nov 15 16:08:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance destroyed successfully.
Nov 15 16:08:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:08:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33b738b-31fb-47c5-8a8c-4aa69d2b45c6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.853s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:08:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:08:53 user nova-compute[75095]: WARNING nova.compute.manager [req-90633e6e-d148-43b8-ae99-989ca69f82ee req-930f1eeb-a12a-4bfb-a86b-abf82b15ec67 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:08:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:57 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:08:57 user nova-compute[75095]: INFO nova.compute.claims [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Claim successful on node user
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:08:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.policy [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae4c178bfe944f58a004a7f15795121b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56e3ee465fc544fe81da6ef40da50d48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:08:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Creating image(s)
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "/opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "/opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "/opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG nova.virt.images [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] 30766bc3-1312-410d-97ad-8eb6a881dbef was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.part /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Successfully created port: e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.part /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.converted" returned: 0 in 0.341s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.265s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937,backing_fmt=raw /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937,backing_fmt=raw /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk 1073741824" returned: 0 in 0.060s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "8f6df270b94d72ea5b1b373caf2ab4cfcdde1937" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:08:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Successfully updated port: e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing instance network info cache due to event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Cannot resize image /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Ensure instance console log exists: /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance network_info: |[{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Start _get_guest_xml network_info=[{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T16:08:55Z,direct_url=<?>,disk_format='qcow2',id=30766bc3-1312-410d-97ad-8eb6a881dbef,min_disk=0,min_ram=0,name='tempest-scenario-img--666177570',owner='56e3ee465fc544fe81da6ef40da50d48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T16:08:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '30766bc3-1312-410d-97ad-8eb6a881dbef'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:09:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T16:08:55Z,direct_url=<?>,disk_format='qcow2',id=30766bc3-1312-410d-97ad-8eb6a881dbef,min_disk=0,min_ram=0,name='tempest-scenario-img--666177570',owner='56e3ee465fc544fe81da6ef40da50d48',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T16:08:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-826767005',display_name='tempest-TestMinimumBasicScenario-server-826767005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-826767005',id=45,image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfepHLFzknpiTUKy7/tqkhzaEi3qSfL+mnvJaJg6cBpMjXEpQh1tHYwnoJUIoEPbRPIxLqYbQiNlTqvDuW41fk2BB6/8rAsWFamKobRhwD0xcvA0pl2UWlHlSHP7g/9bw==',key_name='tempest-TestMinimumBasicScenario-2049271884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-9cknjy01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:08:58Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=943efe10-62c6-4e07-a980-0f9d668eb9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'pci_devices' on Instance uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:09:00 user nova-compute[75095]:   <uuid>943efe10-62c6-4e07-a980-0f9d668eb9a9</uuid>
Nov 15 16:09:00 user nova-compute[75095]:   <name>instance-0000002d</name>
Nov 15 16:09:00 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:09:00 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:09:00 user nova-compute[75095]:   <metadata>
Nov 15 16:09:00 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:09:00 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:name>tempest-TestMinimumBasicScenario-server-826767005</nova:name>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:09:00</nova:creationTime>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:09:00 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:09:00 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:owner>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:user uuid="ae4c178bfe944f58a004a7f15795121b">tempest-TestMinimumBasicScenario-844854400-project-member</nova:user>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:project uuid="56e3ee465fc544fe81da6ef40da50d48">tempest-TestMinimumBasicScenario-844854400</nova:project>
Nov 15 16:09:00 user nova-compute[75095]:       </nova:owner>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:root type="image" uuid="30766bc3-1312-410d-97ad-8eb6a881dbef"/>
Nov 15 16:09:00 user nova-compute[75095]:       <nova:ports>
Nov 15 16:09:00 user nova-compute[75095]:         <nova:port uuid="e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0">
Nov 15 16:09:00 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 16:09:00 user nova-compute[75095]:         </nova:port>
Nov 15 16:09:00 user nova-compute[75095]:       </nova:ports>
Nov 15 16:09:00 user nova-compute[75095]:     </nova:instance>
Nov 15 16:09:00 user nova-compute[75095]:   </metadata>
Nov 15 16:09:00 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:09:00 user nova-compute[75095]:     <system>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="serial">943efe10-62c6-4e07-a980-0f9d668eb9a9</entry>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="uuid">943efe10-62c6-4e07-a980-0f9d668eb9a9</entry>
Nov 15 16:09:00 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:09:00 user nova-compute[75095]:     </system>
Nov 15 16:09:00 user nova-compute[75095]:   </sysinfo>
Nov 15 16:09:00 user nova-compute[75095]:   <os>
Nov 15 16:09:00 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:09:00 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:09:00 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:09:00 user nova-compute[75095]:   </os>
Nov 15 16:09:00 user nova-compute[75095]:   <features>
Nov 15 16:09:00 user nova-compute[75095]:     <acpi/>
Nov 15 16:09:00 user nova-compute[75095]:     <apic/>
Nov 15 16:09:00 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:09:00 user nova-compute[75095]:   </features>
Nov 15 16:09:00 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:09:00 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:09:00 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:09:00 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:09:00 user nova-compute[75095]:   </clock>
Nov 15 16:09:00 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:09:00 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:09:00 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:09:00 user nova-compute[75095]:   </cpu>
Nov 15 16:09:00 user nova-compute[75095]:   <devices>
Nov 15 16:09:00 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:09:00 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:09:00 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk"/>
Nov 15 16:09:00 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:09:00 user nova-compute[75095]:     </disk>
Nov 15 16:09:00 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:09:00 user nova-compute[75095]:       <mac address="fa:16:3e:16:59:43"/>
Nov 15 16:09:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:09:00 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:09:00 user nova-compute[75095]:       <target dev="tape3fb8ae5-df"/>
Nov 15 16:09:00 user nova-compute[75095]:     </interface>
Nov 15 16:09:00 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:09:00 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/console.log" append="off"/>
Nov 15 16:09:00 user nova-compute[75095]:     </serial>
Nov 15 16:09:00 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:09:00 user nova-compute[75095]:     <video>
Nov 15 16:09:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:09:00 user nova-compute[75095]:     </video>
Nov 15 16:09:00 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:09:00 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:09:00 user nova-compute[75095]:     </rng>
Nov 15 16:09:00 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:09:00 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:09:00 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:09:00 user nova-compute[75095]:     </memballoon>
Nov 15 16:09:00 user nova-compute[75095]:   </devices>
Nov 15 16:09:00 user nova-compute[75095]: </domain>
Nov 15 16:09:00 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-826767005',display_name='tempest-TestMinimumBasicScenario-server-826767005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-826767005',id=45,image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfepHLFzknpiTUKy7/tqkhzaEi3qSfL+mnvJaJg6cBpMjXEpQh1tHYwnoJUIoEPbRPIxLqYbQiNlTqvDuW41fk2BB6/8rAsWFamKobRhwD0xcvA0pl2UWlHlSHP7g/9bw==',key_name='tempest-TestMinimumBasicScenario-2049271884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-9cknjy01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:08:58Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=943efe10-62c6-4e07-a980-0f9d668eb9a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG os_vif [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cb977d5-09a6-56ef-9486-6ba0380a5ce4', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3fb8ae5-df, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape3fb8ae5-df, col_values=(('qos', UUID('b7508aeb-8226-41cf-b20d-9b349fe99e86')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape3fb8ae5-df, col_values=(('external_ids', {'iface-id': 'e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:59:43', 'vm-uuid': '943efe10-62c6-4e07-a980-0f9d668eb9a9'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:00 user nova-compute[75095]: INFO os_vif [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df')
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:09:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No VIF found with MAC fa:16:3e:16:59:43, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated VIF entry in instance network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4d8db603-7d55-4194-8f13-d183b242c985 req-8eeb9a05-326e-4d58-9560-1b1c158b78a6 service nova] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:09:02 user nova-compute[75095]: WARNING nova.compute.manager [req-aafae530-3839-4157-aa27-fd89246ad57d req-3385cecc-f0cd-4fbf-bb37-83f1d67b299d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state building and task_state spawning.
Nov 15 16:09:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:09:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance spawned successfully.
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:09:04 user nova-compute[75095]: WARNING nova.compute.manager [req-5460332d-9fb8-4f35-b30a-fb3647756f0e req-52874105-a039-4591-95e8-b6502c49bd79 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state building and task_state spawning.
Nov 15 16:09:04 user nova-compute[75095]: INFO nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Took 5.91 seconds to spawn the instance on the hypervisor.
Nov 15 16:09:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:09:04 user nova-compute[75095]: INFO nova.compute.manager [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Took 6.50 seconds to build instance.
Nov 15 16:09:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f118940-73cb-4582-99e8-f9352eb23bbb tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.642s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:24 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:09:24 user nova-compute[75095]: INFO nova.compute.claims [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Claim successful on node user
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:09:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.policy [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bac844ae1f345e79e89acb0cfc8c4d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61d11880351b4cb6b30085b160c4a460', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:09:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Creating image(s)
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk 1073741824" returned: 0 in 0.055s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Successfully created port: 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:09:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Cannot resize image /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Successfully updated port: 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.compute.manager [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing instance network info cache due to event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance network_info: |[{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.neutron [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start _get_guest_xml network_info=[{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:09:26 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:26 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmMvHV8xDHklDPhW8XA494wktzZ26sW0jawVZ6ypfLr42e2sDo/CVJaTHgzJr3Lmx+1TL9N23KjLdZHduXKBE9y8C0xIwONoTzF3jtBkkyhFrHHAHzIxscSVSEjCZeXfA==',key_name='tempest-keypair-1567347712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.objects.instance [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:09:26 user nova-compute[75095]:   <uuid>8cd1eff7-5913-4343-a629-e7c752c14e00</uuid>
Nov 15 16:09:26 user nova-compute[75095]:   <name>instance-0000002e</name>
Nov 15 16:09:26 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:09:26 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:09:26 user nova-compute[75095]:   <metadata>
Nov 15 16:09:26 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:09:26 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1567237612</nova:name>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:09:26</nova:creationTime>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:09:26 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:09:26 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:owner>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:user uuid="8bac844ae1f345e79e89acb0cfc8c4d8">tempest-AttachVolumeShelveTestJSON-1599642998-project-member</nova:user>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:project uuid="61d11880351b4cb6b30085b160c4a460">tempest-AttachVolumeShelveTestJSON-1599642998</nova:project>
Nov 15 16:09:26 user nova-compute[75095]:       </nova:owner>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:09:26 user nova-compute[75095]:       <nova:ports>
Nov 15 16:09:26 user nova-compute[75095]:         <nova:port uuid="154c8d2a-f72d-4484-bd0d-d0356c160349">
Nov 15 16:09:26 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 16:09:26 user nova-compute[75095]:         </nova:port>
Nov 15 16:09:26 user nova-compute[75095]:       </nova:ports>
Nov 15 16:09:26 user nova-compute[75095]:     </nova:instance>
Nov 15 16:09:26 user nova-compute[75095]:   </metadata>
Nov 15 16:09:26 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:09:26 user nova-compute[75095]:     <system>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="serial">8cd1eff7-5913-4343-a629-e7c752c14e00</entry>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="uuid">8cd1eff7-5913-4343-a629-e7c752c14e00</entry>
Nov 15 16:09:26 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:09:26 user nova-compute[75095]:     </system>
Nov 15 16:09:26 user nova-compute[75095]:   </sysinfo>
Nov 15 16:09:26 user nova-compute[75095]:   <os>
Nov 15 16:09:26 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:09:26 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:09:26 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:09:26 user nova-compute[75095]:   </os>
Nov 15 16:09:26 user nova-compute[75095]:   <features>
Nov 15 16:09:26 user nova-compute[75095]:     <acpi/>
Nov 15 16:09:26 user nova-compute[75095]:     <apic/>
Nov 15 16:09:26 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:09:26 user nova-compute[75095]:   </features>
Nov 15 16:09:26 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:09:26 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:09:26 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:09:26 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:09:26 user nova-compute[75095]:   </clock>
Nov 15 16:09:26 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:09:26 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:09:26 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:09:26 user nova-compute[75095]:   </cpu>
Nov 15 16:09:26 user nova-compute[75095]:   <devices>
Nov 15 16:09:26 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:09:26 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:09:26 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk"/>
Nov 15 16:09:26 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:09:26 user nova-compute[75095]:     </disk>
Nov 15 16:09:26 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:09:26 user nova-compute[75095]:       <mac address="fa:16:3e:d4:75:c3"/>
Nov 15 16:09:26 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:09:26 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:09:26 user nova-compute[75095]:       <target dev="tap154c8d2a-f7"/>
Nov 15 16:09:26 user nova-compute[75095]:     </interface>
Nov 15 16:09:26 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:09:26 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/console.log" append="off"/>
Nov 15 16:09:26 user nova-compute[75095]:     </serial>
Nov 15 16:09:26 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:09:26 user nova-compute[75095]:     <video>
Nov 15 16:09:26 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:09:26 user nova-compute[75095]:     </video>
Nov 15 16:09:26 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:09:26 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:09:26 user nova-compute[75095]:     </rng>
Nov 15 16:09:26 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:09:26 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:09:26 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:09:26 user nova-compute[75095]:     </memballoon>
Nov 15 16:09:26 user nova-compute[75095]:   </devices>
Nov 15 16:09:26 user nova-compute[75095]: </domain>
Nov 15 16:09:26 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmMvHV8xDHklDPhW8XA494wktzZ26sW0jawVZ6ypfLr42e2sDo/CVJaTHgzJr3Lmx+1TL9N23KjLdZHduXKBE9y8C0xIwONoTzF3jtBkkyhFrHHAHzIxscSVSEjCZeXfA==',key_name='tempest-keypair-1567347712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:09:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG os_vif [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23075f95-d5b8-590c-885f-fae69f72be00', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap154c8d2a-f7, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap154c8d2a-f7, col_values=(('qos', UUID('77e280c6-3b81-437c-a849-2410e9adec67')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap154c8d2a-f7, col_values=(('external_ids', {'iface-id': '154c8d2a-f72d-4484-bd0d-d0356c160349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:75:c3', 'vm-uuid': '8cd1eff7-5913-4343-a629-e7c752c14e00'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:09:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:26 user nova-compute[75095]: INFO os_vif [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7')
Nov 15 16:09:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:09:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No VIF found with MAC fa:16:3e:d4:75:c3, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:09:27 user nova-compute[75095]: DEBUG nova.network.neutron [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updated VIF entry in instance network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:09:27 user nova-compute[75095]: DEBUG nova.network.neutron [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:09:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2cd035eb-7de3-4a0c-b901-6ed1378a1db1 req-da384db4-0516-48e0-9a2f-0aefcdf6a806 service nova] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:09:28 user nova-compute[75095]: WARNING nova.compute.manager [req-9676f3e8-fbf2-4073-8bae-cb614ec9c0b1 req-2c1b0d4a-8a01-4860-982b-5b5ef1ba27f2 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state building and task_state spawning.
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:29 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:09:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:09:29 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:09:30 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance spawned successfully.
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:09:30 user nova-compute[75095]: INFO nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:09:30 user nova-compute[75095]: WARNING nova.compute.manager [req-04d3a21c-6d35-4c95-a7b8-9a9ca25c6d67 req-df96d025-6f61-4e36-8577-6eaf97f42a24 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state active and task_state None.
Nov 15 16:09:30 user nova-compute[75095]: INFO nova.compute.manager [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Took 5.86 seconds to build instance.
Nov 15 16:09:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-03a34764-ec73-47ad-8196-0446f3a1fb9f tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.946s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:09:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:09:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8549MB free_disk=24.342910766601562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8cd1eff7-5913-4343-a629-e7c752c14e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:09:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:09:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:09:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:10:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-changed-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Refreshing instance network info cache due to event network-changed-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:10:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] Acquiring lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] Acquired lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:19 user nova-compute[75095]: DEBUG nova.network.neutron [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Refreshing network info cache for port 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:10:20 user nova-compute[75095]: DEBUG nova.network.neutron [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updated VIF entry in instance network info cache for port 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:10:20 user nova-compute[75095]: DEBUG nova.network.neutron [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:10:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7dd0e7d5-95a9-4777-98da-3b542f3b75d4 req-01a0d149-84e4-4cc5-8114-d177f69dcc01 service nova] Releasing lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:21 user nova-compute[75095]: INFO nova.compute.manager [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Attaching volume e83b38b6-10a0-4031-8efd-8082a8336b3a to /dev/vdb
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[152d03fc-f169-4b55-bc04-2404bd2e0923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17ca44a-67d8-4139-ac9b-b65db6311f8c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c61e9-c215-4417-b8e8-dc1d4e15e0b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec571fe-fbcd-45c5-bf25-50d2c1464f38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:10:21 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:10:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e1492d-03f6-4a27-aad1-b6cb64e26a8f]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG os_brick.utils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating existing volume attachment record: ea2cf227-794b-47c4-96fb-75576c5e5e5f {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:10:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlTucyLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:26 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:26 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d73d9c4-f6e1-4d1c-93c6-bdf707346671]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:10:26 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a9fcb8-b7ac-4298-b850-21966da44275]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a] added
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6fefe9-c4d8-4b23-8859-a93c80f2a8b9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59d0f4-c761-4ef0-83e6-37879ba144a9]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlTucyLe {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xlTucyLe" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2656ba0-6024-4552-aa76-63cd8b7f568a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xlTucyLe'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[515fdb39-0cc8-447f-89d0-c26732e739d3]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9677b268-3d80-4075-871a-5329073a12e7]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4009e7-c10a-4a48-a7b9-1694b090c448]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260]
Nov 15 16:10:26 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260] successful.
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[60348798-9954-4879-b225-7ed77c8ec7d4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b455ec3-add2-4783-bdbb-755285b10686]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:26 user nova-compute[75095]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:26 user nova-compute[75095]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:26 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32879363-62f2-4f93-89c6-17a8c1e4abc3]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlTucyLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:10:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23135356366363933', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135356366363933', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.objects.instance [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:10:27 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:10:27 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:10:27 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:10:27 user nova-compute[75095]:   <serial>e83b38b6-10a0-4031-8efd-8082a8336b3a</serial>
Nov 15 16:10:27 user nova-compute[75095]: </disk>
Nov 15 16:10:27 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:10:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:20:38:ab, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:10:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-199470b4-3658-4c90-b814-c32b39850dc8 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.483s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:10:31 user nova-compute[75095]: INFO nova.compute.claims [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Claim successful on node user
Nov 15 16:10:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.271s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:10:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.policy [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c77613061a8c475087e49aedec4a9bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228614fdcc87477786a1c9c97b366eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:10:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Creating image(s)
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "/opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk 1073741824" returned: 0 in 0.058s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.195s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Successfully created port: 66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Cannot resize image /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Ensure instance console log exists: /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Successfully updated port: 66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquired lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-changed-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Refreshing instance network info cache due to event network-changed-66a2aad6-f5b1-497a-8289-f7dcc971ec2c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] Acquiring lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updating instance_info_cache with network_info: [{"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Releasing lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Instance network_info: |[{"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] Acquired lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Refreshing network info cache for port 66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Start _get_guest_xml network_info=[{"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:10:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1032277699',display_name='tempest-AttachVolumeNegativeTest-server-1032277699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1032277699',id=47,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEmulbHCSBi4qjnRDGHkfFWWVz2l0OXCDGE/rApmrXKwv37SbrtfxJ5GYkDNhl8HUAsZ0J4ZzR4nLNzbnQ1WTX1iWr+XKvxkAxODvi4Jha2WGn7/5m8IGTduOea4qCm4w==',key_name='tempest-keypair-1826440692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-f3m0w2yv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=c944b273-a84c-420b-a694-56f8f2f6254e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'pci_devices' on Instance uuid c944b273-a84c-420b-a694-56f8f2f6254e {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:10:34 user nova-compute[75095]:   <uuid>c944b273-a84c-420b-a694-56f8f2f6254e</uuid>
Nov 15 16:10:34 user nova-compute[75095]:   <name>instance-0000002f</name>
Nov 15 16:10:34 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:10:34 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:10:34 user nova-compute[75095]:   <metadata>
Nov 15 16:10:34 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:10:34 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1032277699</nova:name>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:10:34</nova:creationTime>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:10:34 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:10:34 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:owner>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:user uuid="c77613061a8c475087e49aedec4a9bd0">tempest-AttachVolumeNegativeTest-677596313-project-member</nova:user>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:project uuid="228614fdcc87477786a1c9c97b366eeb">tempest-AttachVolumeNegativeTest-677596313</nova:project>
Nov 15 16:10:34 user nova-compute[75095]:       </nova:owner>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:10:34 user nova-compute[75095]:       <nova:ports>
Nov 15 16:10:34 user nova-compute[75095]:         <nova:port uuid="66a2aad6-f5b1-497a-8289-f7dcc971ec2c">
Nov 15 16:10:34 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 16:10:34 user nova-compute[75095]:         </nova:port>
Nov 15 16:10:34 user nova-compute[75095]:       </nova:ports>
Nov 15 16:10:34 user nova-compute[75095]:     </nova:instance>
Nov 15 16:10:34 user nova-compute[75095]:   </metadata>
Nov 15 16:10:34 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:10:34 user nova-compute[75095]:     <system>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="serial">c944b273-a84c-420b-a694-56f8f2f6254e</entry>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="uuid">c944b273-a84c-420b-a694-56f8f2f6254e</entry>
Nov 15 16:10:34 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:10:34 user nova-compute[75095]:     </system>
Nov 15 16:10:34 user nova-compute[75095]:   </sysinfo>
Nov 15 16:10:34 user nova-compute[75095]:   <os>
Nov 15 16:10:34 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:10:34 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:10:34 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:10:34 user nova-compute[75095]:   </os>
Nov 15 16:10:34 user nova-compute[75095]:   <features>
Nov 15 16:10:34 user nova-compute[75095]:     <acpi/>
Nov 15 16:10:34 user nova-compute[75095]:     <apic/>
Nov 15 16:10:34 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:10:34 user nova-compute[75095]:   </features>
Nov 15 16:10:34 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:10:34 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:10:34 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:10:34 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:10:34 user nova-compute[75095]:   </clock>
Nov 15 16:10:34 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:10:34 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:10:34 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:10:34 user nova-compute[75095]:   </cpu>
Nov 15 16:10:34 user nova-compute[75095]:   <devices>
Nov 15 16:10:34 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:10:34 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:10:34 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk"/>
Nov 15 16:10:34 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:10:34 user nova-compute[75095]:     </disk>
Nov 15 16:10:34 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:10:34 user nova-compute[75095]:       <mac address="fa:16:3e:69:46:f0"/>
Nov 15 16:10:34 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:10:34 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:10:34 user nova-compute[75095]:       <target dev="tap66a2aad6-f5"/>
Nov 15 16:10:34 user nova-compute[75095]:     </interface>
Nov 15 16:10:34 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:10:34 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/console.log" append="off"/>
Nov 15 16:10:34 user nova-compute[75095]:     </serial>
Nov 15 16:10:34 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:10:34 user nova-compute[75095]:     <video>
Nov 15 16:10:34 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:10:34 user nova-compute[75095]:     </video>
Nov 15 16:10:34 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:10:34 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:10:34 user nova-compute[75095]:     </rng>
Nov 15 16:10:34 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:10:34 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:10:34 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:10:34 user nova-compute[75095]:     </memballoon>
Nov 15 16:10:34 user nova-compute[75095]:   </devices>
Nov 15 16:10:34 user nova-compute[75095]: </domain>
Nov 15 16:10:34 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1032277699',display_name='tempest-AttachVolumeNegativeTest-server-1032277699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1032277699',id=47,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEmulbHCSBi4qjnRDGHkfFWWVz2l0OXCDGE/rApmrXKwv37SbrtfxJ5GYkDNhl8HUAsZ0J4ZzR4nLNzbnQ1WTX1iWr+XKvxkAxODvi4Jha2WGn7/5m8IGTduOea4qCm4w==',key_name='tempest-keypair-1826440692',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-f3m0w2yv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:10:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=c944b273-a84c-420b-a694-56f8f2f6254e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG os_vif [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10302f3d-ab57-5b89-867a-d5c97ae9207b', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66a2aad6-f5, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66a2aad6-f5, col_values=(('qos', UUID('7a70ce9e-c5d8-4669-99f1-985c9e513908')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66a2aad6-f5, col_values=(('external_ids', {'iface-id': '66a2aad6-f5b1-497a-8289-f7dcc971ec2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:46:f0', 'vm-uuid': 'c944b273-a84c-420b-a694-56f8f2f6254e'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:34 user nova-compute[75095]: INFO os_vif [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5')
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:69:46:f0, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updated VIF entry in instance network info cache for port 66a2aad6-f5b1-497a-8289-f7dcc971ec2c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updating instance_info_cache with network_info: [{"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-064ef039-fd8b-4347-83a0-a7cd332320c5 req-bed7ba88-fb0a-4ff9-b3f2-f2d171b37ca3 service nova] Releasing lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] No waiting events found dispatching network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:10:35 user nova-compute[75095]: WARNING nova.compute.manager [req-d06a192e-8514-4e89-9375-6a09c236b146 req-3175547a-6bdb-47be-a34e-d58ff2a4a5cc service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received unexpected event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c for instance with vm_state building and task_state spawning.
Nov 15 16:10:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:10:37 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Instance spawned successfully.
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:10:37 user nova-compute[75095]: INFO nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Took 5.48 seconds to spawn the instance on the hypervisor.
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:10:37 user nova-compute[75095]: INFO nova.compute.manager [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Took 6.06 seconds to build instance.
Nov 15 16:10:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e33814d8-3514-4870-93d1-dd67ef3c7b2b tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.165s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:37 user nova-compute[75095]: DEBUG nova.compute.manager [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] No waiting events found dispatching network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:10:37 user nova-compute[75095]: WARNING nova.compute.manager [req-6c575869-957e-46f7-9e0a-2a0c71889631 req-9b1c665c-caf2-4451-baec-8ddf00cd0933 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received unexpected event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c for instance with vm_state active and task_state None.
Nov 15 16:10:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'info_cache' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:41 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:10:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance destroyed successfully.
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'resources' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b9a48d-68, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f45979a-2385-4d8a-bbd0-72237baae97f) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:42 user nova-compute[75095]: INFO os_vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e34a4-79ee-473a-8b21-6fefcf377937]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:10:42 user nova-compute[75095]: No targets found.
Nov 15 16:10:42 user nova-compute[75095]: iSNS:
Nov 15 16:10:42 user nova-compute[75095]: No targets found.
Nov 15 16:10:42 user nova-compute[75095]: STATIC:
Nov 15 16:10:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6
Nov 15 16:10:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:10:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:10:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a
Nov 15 16:10:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:10:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:10:42 user nova-compute[75095]: FIRMWARE:
Nov 15 16:10:42 user nova-compute[75095]: No targets found.
Nov 15 16:10:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:10:42 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:10:42 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f8f082-47f1-480b-b5db-eff808dc223d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c20db5-85e4-4cdb-90a9-426cf149002c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:42 user nova-compute[75095]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:42 user nova-compute[75095]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c36f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9e9a6c-1a64-43f6-9957-6454bda34d26]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7742fc-f8cd-446a-9f26-c0c0eda06454]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e176d7-d571-457c-883b-9317a360f780]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c36e5f8-9d75-4051-96ea-457a337b23d7]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d67a795-f574-4a86-bcc4-e63fcbe09e84]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d7beb3-cbe2-4049-963e-310987186aa2]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]
Nov 15 16:10:42 user nova-compute[75095]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.
Nov 15 16:10:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5bb446-2bd4-407b-bfb2-ce4277ae74bd]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== disconnect_volume: return (330ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start _get_guest_xml network_info=[{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'attachment_id': '71672c00-e4a9-4930-9207-38594e29618f', 'delete_on_termination': False, 'disk_bus': 'virtio', 'boot_index': None, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '08918122-86d9-40c8-8a72-046aba3a3fc6', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'serial': 'fb140e19-04ed-46de-9e8d-0eb284acc8a6'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'numa_topology' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:42 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0758ba-88ca-40f7-872e-eb9e8adc1d02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:10:42 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff24ae-a118-4380-9b4a-7372eb185537]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6] added
Nov 15 16:10:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6233d41c-b974-44c3-833b-86abf2fa3cfa]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[863336e8-591b-4b44-8dbf-8a31facbc3be]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbNCVzJn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbNCVzJn" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25487a-18ba-4a67-a128-9f9f6db9ffa1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbNCVzJn'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82f381-c9c5-487e-95c1-bf76384e281a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5f633-ae06-47d7-bfba-7f37ca9319c7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0265e8c-3a58-4cb8-841b-00fa25a32a86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]
Nov 15 16:10:43 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.
Nov 15 16:10:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45981c11-5773-4839-9244-7f7dedf3e114]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf6b69e-a508-4c99-966e-8b8a82cc79ed]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:43 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:43 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac57127-c2df-42a1-915f-fba56a6c4b2b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Error from libvirt while getting description of instance-0000002b: [Error Code 42] Domain not found: no domain with matching uuid '08918122-86d9-40c8-8a72-046aba3a3fc6' (instance-0000002b): libvirt.libvirtError: Domain not found: no domain with matching uuid '08918122-86d9-40c8-8a72-046aba3a3fc6' (instance-0000002b)
Nov 15 16:10:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8537MB free_disk=24.323360443115234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8cd1eff7-5913-4343-a629-e7c752c14e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c944b273-a84c-420b-a694-56f8f2f6254e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:10:43 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23433303138616531', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433303138616531', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'pci_devices' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:10:44 user nova-compute[75095]:   <uuid>08918122-86d9-40c8-8a72-046aba3a3fc6</uuid>
Nov 15 16:10:44 user nova-compute[75095]:   <name>instance-0000002b</name>
Nov 15 16:10:44 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:10:44 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:10:44 user nova-compute[75095]:   <metadata>
Nov 15 16:10:44 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:10:44 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeTestJSON-server-697539317</nova:name>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:10:42</nova:creationTime>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:10:44 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:10:44 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:owner>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:user uuid="affac16301c14d9bb758222765b5f600">tempest-AttachVolumeTestJSON-640760510-project-member</nova:user>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:project uuid="56b8acac89af43a2a6c63b27f6d56528">tempest-AttachVolumeTestJSON-640760510</nova:project>
Nov 15 16:10:44 user nova-compute[75095]:       </nova:owner>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:10:44 user nova-compute[75095]:       <nova:ports>
Nov 15 16:10:44 user nova-compute[75095]:         <nova:port uuid="01b9a48d-6824-42df-b799-8b229992efee">
Nov 15 16:10:44 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 16:10:44 user nova-compute[75095]:         </nova:port>
Nov 15 16:10:44 user nova-compute[75095]:       </nova:ports>
Nov 15 16:10:44 user nova-compute[75095]:     </nova:instance>
Nov 15 16:10:44 user nova-compute[75095]:   </metadata>
Nov 15 16:10:44 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:10:44 user nova-compute[75095]:     <system>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="serial">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="uuid">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:10:44 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:10:44 user nova-compute[75095]:     </system>
Nov 15 16:10:44 user nova-compute[75095]:   </sysinfo>
Nov 15 16:10:44 user nova-compute[75095]:   <os>
Nov 15 16:10:44 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:10:44 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:10:44 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:10:44 user nova-compute[75095]:   </os>
Nov 15 16:10:44 user nova-compute[75095]:   <features>
Nov 15 16:10:44 user nova-compute[75095]:     <acpi/>
Nov 15 16:10:44 user nova-compute[75095]:     <apic/>
Nov 15 16:10:44 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:10:44 user nova-compute[75095]:   </features>
Nov 15 16:10:44 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:10:44 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:10:44 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:10:44 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:10:44 user nova-compute[75095]:   </clock>
Nov 15 16:10:44 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:10:44 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:10:44 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:10:44 user nova-compute[75095]:   </cpu>
Nov 15 16:10:44 user nova-compute[75095]:   <devices>
Nov 15 16:10:44 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:10:44 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:10:44 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk"/>
Nov 15 16:10:44 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:10:44 user nova-compute[75095]:     </disk>
Nov 15 16:10:44 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:10:44 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:10:44 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 16:10:44 user nova-compute[75095]:       <target dev="vdb" bus="virtio"/>
Nov 15 16:10:44 user nova-compute[75095]:       <serial>fb140e19-04ed-46de-9e8d-0eb284acc8a6</serial>
Nov 15 16:10:44 user nova-compute[75095]:     </disk>
Nov 15 16:10:44 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:10:44 user nova-compute[75095]:       <mac address="fa:16:3e:b5:79:da"/>
Nov 15 16:10:44 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:10:44 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:10:44 user nova-compute[75095]:       <target dev="tap01b9a48d-68"/>
Nov 15 16:10:44 user nova-compute[75095]:     </interface>
Nov 15 16:10:44 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:10:44 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/console.log" append="off"/>
Nov 15 16:10:44 user nova-compute[75095]:     </serial>
Nov 15 16:10:44 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:10:44 user nova-compute[75095]:     <video>
Nov 15 16:10:44 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:10:44 user nova-compute[75095]:     </video>
Nov 15 16:10:44 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:10:44 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:10:44 user nova-compute[75095]:     </rng>
Nov 15 16:10:44 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:10:44 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:10:44 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:10:44 user nova-compute[75095]:     </memballoon>
Nov 15 16:10:44 user nova-compute[75095]:   </devices>
Nov 15 16:10:44 user nova-compute[75095]: </domain>
Nov 15 16:10:44 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Cannot resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'migration_context' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.objects.base [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG os_vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e37dde8-caa3-51d5-969b-c4f3187ef3f5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b9a48d-68, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b9a48d-68, col_values=(('qos', UUID('88f666d3-205a-4ac7-837c-33061749a7dc')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b9a48d-68, col_values=(('external_ids', {'iface-id': '01b9a48d-6824-42df-b799-8b229992efee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:79:da', 'vm-uuid': '08918122-86d9-40c8-8a72-046aba3a3fc6'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:10:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:10:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:45 user nova-compute[75095]: INFO os_vif [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:10:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:10:46 user nova-compute[75095]: WARNING nova.compute.manager [req-c3ad7b36-d5ca-4e45-9bfa-c598b11bf07f req-f5d87f8f-a637-494c-8c3c-a4dc970a24be service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state powering-on.
Nov 15 16:10:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:10:48 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance rebooted successfully.
Nov 15 16:10:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d26c489d-91eb-4029-91c0-d4ba50870c19 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:48 user nova-compute[75095]: DEBUG nova.compute.manager [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:10:48 user nova-compute[75095]: WARNING nova.compute.manager [req-9e48f7dc-82be-4814-a910-f783b93ba9bb req-7f1fc461-8ad0-4cdb-bbf7-d39fab7fd594 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state active and task_state None.
Nov 15 16:10:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:10:50 user nova-compute[75095]: INFO nova.compute.manager [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Attaching volume f3b879cf-90ea-4340-9c8c-022ccfd0d461 to /dev/vdb
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5f575-e219-4318-b44d-711111d0c768]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5d0037-bcb2-42b4-bed3-ca3ae8a281eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77ec0d-0d3e-41f8-aa15-8092975af0a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[953c7774-45cb-4cc4-a5e2-0cf1a8a5d162]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:10:50 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:10:50 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fceb6282-66b2-4e32-ace8-3b474150555e]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:50 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating existing volume attachment record: 7e1627f9-acdb-4e42-acec-cf9b07997157 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:10:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNeabmGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:10:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:10:55 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b339d9b-a07e-4239-be99-894ea14197f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:10:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d1347-2954-449f-8869-33909a948d99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461] added
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[66405337-8486-47e9-b5ef-6a01b0841d60]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae13f1b-4e3b-4ad1-a4db-456c377ba478]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNeabmGv {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qNeabmGv" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ccb83-d872-4497-8e1c-e0b6a7d30df8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qNeabmGv'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e538c86-729e-4560-a3c9-3697b6c7a3f2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c39dec3-5832-40be-8826-0e63ccd30666]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af697f52-031a-44fb-9200-c9c19e892b5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260]
Nov 15 16:10:55 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260] successful.
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef7dec9-a52d-43f7-9a59-026ebb74df4a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb57c3-e7ed-49d5-8fc5-0bc1d806f8b1]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:10:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[505e4f83-1891-48e2-b905-49a4d0267d5d]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:10:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNeabmGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26537653835623636', 'path': '/dev/sdd'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537653835623636', 'path': '/dev/sdd'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:10:56 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:10:56 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 16:10:56 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:10:56 user nova-compute[75095]:   <serial>f3b879cf-90ea-4340-9c8c-022ccfd0d461</serial>
Nov 15 16:10:56 user nova-compute[75095]: </disk>
Nov 15 16:10:56 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:10:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] No VIF found with MAC fa:16:3e:16:59:43, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:10:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc7260c6-6e16-498b-a326-a13154093b47 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.919s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG nova.compute.manager [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing instance network info cache due to event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:10:59 user nova-compute[75095]: DEBUG nova.network.neutron [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:11:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated VIF entry in instance network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:11:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-841ae1a6-33e8-4983-8b90-c30fcf4deb79 req-392e80ee-b68a-4d5d-af8a-b0bd73392bf6 service nova] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing instance network info cache due to event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:11:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated VIF entry in instance network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ec959fd2-fa6f-4d90-946e-7e504cfd049c req-07a89110-26e7-4890-9f11-5fd3ded8565f service nova] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:02 user nova-compute[75095]: INFO nova.compute.manager [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Rebooting instance
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:11:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:05 user nova-compute[75095]: WARNING nova.compute.manager [req-f944d19e-ee4b-4f82-b379-74e9537e0977 req-e88c68f6-ca3a-4075-9b24-1bfd2f37f5f2 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state active and task_state reboot_started.
Nov 15 16:11:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance shutdown successfully.
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:07 user nova-compute[75095]: WARNING nova.compute.manager [req-2b401a6f-3127-4aec-a47f-8bf48172b3e4 req-ef0467a3-8a01-4b23-9a3c-873084f4276d service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state active and task_state reboot_started.
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance running successfully.
Nov 15 16:11:09 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance soft rebooted successfully.
Nov 15 16:11:09 user nova-compute[75095]: DEBUG nova.compute.manager [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:09 user nova-compute[75095]: WARNING nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state active and task_state reboot_started.
Nov 15 16:11:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:09 user nova-compute[75095]: WARNING nova.compute.manager [req-d148e878-2c07-4c56-93d6-112add8fa170 req-a10e84db-b1a7-467b-966a-ec2f282d3c46 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state active and task_state reboot_started.
Nov 15 16:11:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fc701ced-227a-4041-ac13-8c1295c2c473 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.152s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing instance network info cache due to event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:15 user nova-compute[75095]: DEBUG nova.network.neutron [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:11:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updated VIF entry in instance network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:11:16 user nova-compute[75095]: DEBUG nova.network.neutron [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9d7148d5-5cd3-45c4-ad34-e6db65b5c2e6 req-50e73dcd-dec2-44f1-a1d0-149ac9f65cf6 service nova] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:19 user nova-compute[75095]: INFO nova.compute.manager [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Shelving
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG nova.compute.manager [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:19 user nova-compute[75095]: WARNING nova.compute.manager [req-5af6f958-4981-4797-ba1e-ccc7154d15e6 req-854464ab-2b9b-4ba1-bd90-b7b99c1df7e7 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state active and task_state shelving.
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance destroyed successfully.
Nov 15 16:11:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Beginning cold snapshot process
Nov 15 16:11:19 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:11:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk /opt/stack/data/nova/instances/snapshots/tmpuid3rkt_/26434282e4cc4e9ab0a035ba24cda0e7 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk /opt/stack/data/nova/instances/snapshots/tmpuid3rkt_/26434282e4cc4e9ab0a035ba24cda0e7" returned: 0 in 0.606s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:20 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Snapshot extracted, beginning image upload
Nov 15 16:11:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:11:21 user nova-compute[75095]: WARNING nova.compute.manager [req-925997ef-7ad9-4f80-95b2-785f5ac8a7be req-ff5e3c43-1303-4b78-8509-7c2f47682f4d service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 16:11:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Snapshot image upload complete
Nov 15 16:11:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:11:23 user nova-compute[75095]: INFO nova.compute.manager [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Shelve offloading
Nov 15 16:11:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance destroyed successfully.
Nov 15 16:11:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:11:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:11:23 user nova-compute[75095]: DEBUG nova.network.neutron [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance destroyed successfully.
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'resources' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmMvHV8xDHklDPhW8XA494wktzZ26sW0jawVZ6ypfLr42e2sDo/CVJaTHgzJr3Lmx+1TL9N23KjLdZHduXKBE9y8C0xIwONoTzF3jtBkkyhFrHHAHzIxscSVSEjCZeXfA==',key_name='tempest-keypair-1567347712',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:11:22.945274',shelved_host='user',shelved_image_id='a863b580-57a8-4255-b3a2-68db99be730c'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:11:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG os_vif [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap154c8d2a-f7, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=77e280c6-3b81-437c-a849-2410e9adec67) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:24 user nova-compute[75095]: INFO os_vif [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7')
Nov 15 16:11:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Deleting instance files /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00_del
Nov 15 16:11:24 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Deletion of /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00_del complete
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing instance network info cache due to event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.network.neutron [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:11:24 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Deleted allocations for instance 8cd1eff7-5913-4343-a629-e7c752c14e00
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.objects.base [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<8cd1eff7-5913-4343-a629-e7c752c14e00> lazy-loaded attributes: resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.246s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-10eb68d9-8b09-4a59-9419-3a29c44fa3b0 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.429s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:25 user nova-compute[75095]: DEBUG nova.network.neutron [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updated VIF entry in instance network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:11:25 user nova-compute[75095]: DEBUG nova.network.neutron [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-75a0212d-e159-4bab-b284-89cea1e36a98 req-9336e0b5-e750-49c0-9700-f721b4d3f811 service nova] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:30 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:11:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:11:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:11:30 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:11:31 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:11:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:11:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:11:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:35 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:35 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:35 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:35 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:11:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:11:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:11:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:11:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=24.26354217529297GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance c944b273-a84c-420b-a694-56f8f2f6254e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:11:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:11:46 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:11:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:11:46 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:11:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:11:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:11:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:12:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:12:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:12:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-changed-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Refreshing instance network info cache due to event network-changed-66a2aad6-f5b1-497a-8289-f7dcc971ec2c. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] Acquiring lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] Acquired lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Refreshing network info cache for port 66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:22 user nova-compute[75095]: INFO nova.compute.manager [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Terminating instance
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updated VIF entry in instance network info cache for port 66a2aad6-f5b1-497a-8289-f7dcc971ec2c. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updating instance_info_cache with network_info: [{"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b4adb45d-a1f2-4aa6-980b-bb1c88170302 req-b0c9347a-94bf-4288-b42f-eb26b2962271 service nova] Releasing lock "refresh_cache-c944b273-a84c-420b-a694-56f8f2f6254e" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-unplugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] No waiting events found dispatching network-vif-unplugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-27798367-21c0-4ee9-b899-6fa5e6b67953 req-fb9da034-5322-48d3-a6d0-2932533c790c service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-unplugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Instance destroyed successfully.
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'resources' on Instance uuid c944b273-a84c-420b-a694-56f8f2f6254e {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1032277699',display_name='tempest-AttachVolumeNegativeTest-server-1032277699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1032277699',id=47,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKEmulbHCSBi4qjnRDGHkfFWWVz2l0OXCDGE/rApmrXKwv37SbrtfxJ5GYkDNhl8HUAsZ0J4ZzR4nLNzbnQ1WTX1iWr+XKvxkAxODvi4Jha2WGn7/5m8IGTduOea4qCm4w==',key_name='tempest-keypair-1826440692',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:10:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-f3m0w2yv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=c944b273-a84c-420b-a694-56f8f2f6254e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "address": "fa:16:3e:69:46:f0", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66a2aad6-f5", "ovs_interfaceid": "66a2aad6-f5b1-497a-8289-f7dcc971ec2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG os_vif [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66a2aad6-f5, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a70ce9e-c5d8-4669-99f1-985c9e513908) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:23 user nova-compute[75095]: INFO os_vif [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:46:f0,bridge_name='br-int',has_traffic_filtering=True,id=66a2aad6-f5b1-497a-8289-f7dcc971ec2c,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66a2aad6-f5')
Nov 15 16:12:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Deleting instance files /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e_del
Nov 15 16:12:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Deletion of /opt/stack/data/nova/instances/c944b273-a84c-420b-a694-56f8f2f6254e_del complete
Nov 15 16:12:23 user nova-compute[75095]: INFO nova.compute.manager [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 16:12:23 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:12:23 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:12:24 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Took 0.66 seconds to deallocate network for instance.
Nov 15 16:12:24 user nova-compute[75095]: DEBUG nova.compute.manager [req-c7e46025-4d0c-4943-b304-8e3ce39c33e0 req-9121ab80-f80d-4693-99a5-8b224d7dfc87 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-deleted-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:12:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:24 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Deleted allocations for instance c944b273-a84c-420b-a694-56f8f2f6254e
Nov 15 16:12:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-84847a5d-503d-4ef1-9ccf-019845205186 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "c944b273-a84c-420b-a694-56f8f2f6254e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] Acquiring lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] Lock "c944b273-a84c-420b-a694-56f8f2f6254e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:25 user nova-compute[75095]: DEBUG nova.compute.manager [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] No waiting events found dispatching network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:25 user nova-compute[75095]: WARNING nova.compute.manager [req-ed161e1d-b634-401b-beed-87f341966e17 req-a5955c1c-40dd-4e88-95c9-58f3fc6cadb2 service nova] [instance: c944b273-a84c-420b-a694-56f8f2f6254e] Received unexpected event network-vif-plugged-66a2aad6-f5b1-497a-8289-f7dcc971ec2c for instance with vm_state deleted and task_state None.
Nov 15 16:12:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:33 user nova-compute[75095]: INFO nova.compute.manager [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Detaching volume fb140e19-04ed-46de-9e8d-0eb284acc8a6
Nov 15 16:12:33 user nova-compute[75095]: INFO nova.virt.block_device [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Attempting to driver detach volume fb140e19-04ed-46de-9e8d-0eb284acc8a6 from mountpoint /dev/vdb
Nov 15 16:12:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Attempting to detach device vdb from instance 08918122-86d9-40c8-8a72-046aba3a3fc6 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:12:33 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:12:33 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:12:33 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:12:33 user nova-compute[75095]:   <serial>fb140e19-04ed-46de-9e8d-0eb284acc8a6</serial>
Nov 15 16:12:33 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:12:33 user nova-compute[75095]: </disk>
Nov 15 16:12:33 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:12:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdb from instance 08918122-86d9-40c8-8a72-046aba3a3fc6 from the persistent domain config.
Nov 15 16:12:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 08918122-86d9-40c8-8a72-046aba3a3fc6 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:12:33 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:12:33 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:12:33 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:12:33 user nova-compute[75095]:   <serial>fb140e19-04ed-46de-9e8d-0eb284acc8a6</serial>
Nov 15 16:12:33 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 16:12:33 user nova-compute[75095]: </disk>
Nov 15 16:12:33 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:12:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:12:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:12:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:12:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:12:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=24.290447235107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:12:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:12:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 08918122-86d9-40c8-8a72-046aba3a3fc6 is timed out.
Nov 15 16:12:53 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdb from instance 08918122-86d9-40c8-8a72-046aba3a3fc6 from the live domain config.
Nov 15 16:12:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbNCVzJn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:12:53 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a509235-badf-4572-a9ac-44bb4f3c2be4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:12:53 user nova-compute[75095]: No targets found.
Nov 15 16:12:53 user nova-compute[75095]: iSNS:
Nov 15 16:12:53 user nova-compute[75095]: No targets found.
Nov 15 16:12:53 user nova-compute[75095]: STATIC:
Nov 15 16:12:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6
Nov 15 16:12:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:12:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:12:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a
Nov 15 16:12:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:12:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:12:53 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461
Nov 15 16:12:53 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:12:53 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:12:53 user nova-compute[75095]: FIRMWARE:
Nov 15 16:12:53 user nova-compute[75095]: No targets found.
Nov 15 16:12:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:12:53 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:12:53 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[827dd350-1550-4095-b338-41a3f8ebd17e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f1a546-ee33-4b7b-bbcc-1658dbe6e981]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:12:53 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:12:53 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:12:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:12:53 user nova-compute[75095]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 (non-flash)
Nov 15 16:12:53 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:12:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c270ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cb39e8-c32d-4ef9-923a-50519e0fbd22]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[981c4b5d-c804-4588-b7aa-ab7c97d5947e]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86432c76-c0b5-47dc-9a90-d4225e420be8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG nova.compute.manager [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing instance network info cache due to event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG nova.network.neutron [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9376a5a-22fc-4cd8-923e-9dbc6788d805]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce61aa-0656-4c97-83d1-926bcf1ce1e6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8732c-84eb-48ca-8a7c-91d51c5e693d]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260]
Nov 15 16:12:53 user nova-compute[75095]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6, portal: 172.16.0.220,3260] successful.
Nov 15 16:12:53 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb140e19-04ed-46de-9e8d-0eb284acc8a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc412d1-7ce3-4662-a892-5c72adf9e105]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== disconnect_volume: return (326ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:12:53 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated VIF entry in instance network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-522bb5e1-1ed6-426e-a06a-889df6edb226 req-5adc1eb5-16ce-48b6-8b75-74b5d44281a7 service nova] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG nova.compute.manager [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing instance network info cache due to event network-changed-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] Acquiring lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] Acquired lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:12:54 user nova-compute[75095]: DEBUG nova.network.neutron [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Refreshing network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:55 user nova-compute[75095]: INFO nova.compute.manager [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Detaching volume f3b879cf-90ea-4340-9c8c-022ccfd0d461
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c62f1474-475f-49f2-a0b5-7cdd53670aa6 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.051s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updated VIF entry in instance network info cache for port e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.network.neutron [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [{"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:12:55 user nova-compute[75095]: INFO nova.virt.block_device [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Attempting to driver detach volume f3b879cf-90ea-4340-9c8c-022ccfd0d461 from mountpoint /dev/vdb
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Attempting to detach device vdb from instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:12:55 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:12:55 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 16:12:55 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:12:55 user nova-compute[75095]:   <serial>f3b879cf-90ea-4340-9c8c-022ccfd0d461</serial>
Nov 15 16:12:55 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:12:55 user nova-compute[75095]: </disk>
Nov 15 16:12:55 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b33cd1d3-61cc-4e29-a23b-e8eef6292c8f req-d481b6d5-3e1a-4919-a481-d0d2b78739b1 service nova] Releasing lock "refresh_cache-943efe10-62c6-4e07-a980-0f9d668eb9a9" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:12:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully detached device vdb from instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 from the persistent domain config.
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:12:55 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:12:55 user nova-compute[75095]:   <source dev="/dev/sdd"/>
Nov 15 16:12:55 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:12:55 user nova-compute[75095]:   <serial>f3b879cf-90ea-4340-9c8c-022ccfd0d461</serial>
Nov 15 16:12:55 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:12:55 user nova-compute[75095]: </disk>
Nov 15 16:12:55 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75095) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG nova.compute.manager [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:56 user nova-compute[75095]: WARNING nova.compute.manager [req-82252b27-828d-438e-96af-658e03cf1a6a req-904d4649-ca7d-4949-8882-a0d19565dc50 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state active and task_state powering-off.
Nov 15 16:12:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance destroyed successfully.
Nov 15 16:12:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-010bdca9-739b-4dd5-add0-11256440b3f3 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.883s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:58 user nova-compute[75095]: WARNING nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:58 user nova-compute[75095]: WARNING nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:58 user nova-compute[75095]: WARNING nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:58 user nova-compute[75095]: WARNING nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:12:58 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:12:58 user nova-compute[75095]: WARNING nova.compute.manager [req-9ee5c747-d352-441c-b6d5-46e472651bcf req-77a50063-ffaa-448b-9979-6b6588863433 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state None.
Nov 15 16:12:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:11 user nova-compute[75095]: INFO nova.compute.manager [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Unshelving
Nov 15 16:13:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_requests' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'numa_topology' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:11 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:13:11 user nova-compute[75095]: INFO nova.compute.claims [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Claim successful on node user
Nov 15 16:13:12 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:12 user nova-compute[75095]: INFO nova.network.neutron [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating port 154c8d2a-f72d-4484-bd0d-d0356c160349 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG nova.compute.manager [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing instance network info cache due to event network-changed-154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:13:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] Acquiring lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:13:13 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Creating image(s)
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] Acquired lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Refreshing network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG nova.objects.base [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<8cd1eff7-5913-4343-a629-e7c752c14e00> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.part --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:14 user nova-compute[75095]: INFO nova.compute.manager [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Detaching volume e83b38b6-10a0-4031-8efd-8082a8336b3a
Nov 15 16:13:14 user nova-compute[75095]: INFO nova.virt.block_device [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Attempting to driver detach volume e83b38b6-10a0-4031-8efd-8082a8336b3a from mountpoint /dev/vdb
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Attempting to detach device vdb from instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:13:14 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:13:14 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:13:14 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:13:14 user nova-compute[75095]:   <serial>e83b38b6-10a0-4031-8efd-8082a8336b3a</serial>
Nov 15 16:13:14 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:13:14 user nova-compute[75095]: </disk>
Nov 15 16:13:14 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:13:14 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea from the persistent domain config.
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:13:14 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:13:14 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:13:14 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:13:14 user nova-compute[75095]:   <serial>e83b38b6-10a0-4031-8efd-8082a8336b3a</serial>
Nov 15 16:13:14 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:13:14 user nova-compute[75095]: </disk>
Nov 15 16:13:14 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.part --force-share --output=json" returned: 0 in 0.186s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.virt.images [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] a863b580-57a8-4255-b3a2-68db99be730c was qcow2, converting to raw {{(pid=75095) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.privsep.utils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75095) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.part /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.converted {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updated VIF entry in instance network info cache for port 154c8d2a-f72d-4484-bd0d-d0356c160349. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:13:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-08c90642-e19c-4c7b-a466-b87026ffb128 req-ec102ae1-2bd1-43c8-9eb0-24e28945c631 service nova] Releasing lock "refresh_cache-8cd1eff7-5913-4343-a629-e7c752c14e00" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.part /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.converted" returned: 0 in 0.687s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.converted --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.126s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 is timed out.
Nov 15 16:13:15 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully detached device vdb from instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 from the live domain config.
Nov 15 16:13:15 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qNeabmGv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:13:15 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4d6b28-af9c-4615-9dbf-489793f4d485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:13:15 user nova-compute[75095]: No targets found.
Nov 15 16:13:15 user nova-compute[75095]: iSNS:
Nov 15 16:13:15 user nova-compute[75095]: No targets found.
Nov 15 16:13:15 user nova-compute[75095]: STATIC:
Nov 15 16:13:15 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a
Nov 15 16:13:15 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:13:15 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:13:15 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461
Nov 15 16:13:15 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:13:15 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:13:15 user nova-compute[75095]: FIRMWARE:
Nov 15 16:13:15 user nova-compute[75095]: No targets found.
Nov 15 16:13:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:13:15 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:13:15 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c515b39-5643-4b36-97c9-55a61192b4a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8092c9e-e3dd-4f63-b549-c2b7380263db]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:13:15 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:13:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:13:15 user nova-compute[75095]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 (non-flash)
Nov 15 16:13:15 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3dd2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461'): ({'sdd'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Removing single pathed devices sdd {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[691130d5-5ac0-4d41-8353-d8300c856979]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e232f0-b7ed-4e09-9868-71c8c0456ca8]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Flushing IO for device /dev/sdd {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa462364-4254-45bf-85e8-86b7b4469bf7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c,backing_fmt=raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8dc6f7-7641-4939-8b98-58b566a46166]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] SCSI volumes sdd have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c,backing_fmt=raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk 1073741824" returned: 0 in 0.054s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "5ee7bd22d1e424eb440cfa10274d2d095fcd242c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15b1d73-1e27-4a2c-b8b0-a9bdca5d1644]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e339d-8532-4531-bcff-57ac597414bb]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260]
Nov 15 16:13:16 user nova-compute[75095]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461, portal: 172.16.0.220,3260] successful.
Nov 15 16:13:16 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3b879cf-90ea-4340-9c8c-022ccfd0d461 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e90d96-d0ed-4622-9ced-53c1d4fff52d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] <== disconnect_volume: return (363ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'migration_context' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG nova.objects.base [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<8cd1eff7-5913-4343-a629-e7c752c14e00> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:13:16 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Rebasing disk image.
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 -F raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'flavor' on Instance uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:16 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3f742554-1e82-4ac2-82af-85aab808af50 tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 -F raw /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk" returned: 0 in 2.086s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Ensure instance console log exists: /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start _get_guest_xml network_info=[{"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='74aab816812f8d093d818c2e043144aa',container_format='bare',created_at=2023-11-15T16:11:19Z,direct_url=<?>,disk_format='qcow2',id=a863b580-57a8-4255-b3a2-68db99be730c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1567237612-shelved',owner='61d11880351b4cb6b30085b160c4a460',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T16:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:13:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:13:18 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='74aab816812f8d093d818c2e043144aa',container_format='bare',created_at=2023-11-15T16:11:19Z,direct_url=<?>,disk_format='qcow2',id=a863b580-57a8-4255-b3a2-68db99be730c,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1567237612-shelved',owner='61d11880351b4cb6b30085b160c4a460',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T16:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.objects.base [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<8cd1eff7-5913-4343-a629-e7c752c14e00> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='a863b580-57a8-4255-b3a2-68db99be730c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1567347712',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:11:22.945274',shelved_host='user',shelved_image_id='a863b580-57a8-4255-b3a2-68db99be730c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.objects.base [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Object Instance<8cd1eff7-5913-4343-a629-e7c752c14e00> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:13:18 user nova-compute[75095]:   <uuid>8cd1eff7-5913-4343-a629-e7c752c14e00</uuid>
Nov 15 16:13:18 user nova-compute[75095]:   <name>instance-0000002e</name>
Nov 15 16:13:18 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:13:18 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:13:18 user nova-compute[75095]:   <metadata>
Nov 15 16:13:18 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:13:18 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1567237612</nova:name>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:13:18</nova:creationTime>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:13:18 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:13:18 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:owner>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:user uuid="8bac844ae1f345e79e89acb0cfc8c4d8">tempest-AttachVolumeShelveTestJSON-1599642998-project-member</nova:user>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:project uuid="61d11880351b4cb6b30085b160c4a460">tempest-AttachVolumeShelveTestJSON-1599642998</nova:project>
Nov 15 16:13:18 user nova-compute[75095]:       </nova:owner>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:root type="image" uuid="a863b580-57a8-4255-b3a2-68db99be730c"/>
Nov 15 16:13:18 user nova-compute[75095]:       <nova:ports>
Nov 15 16:13:18 user nova-compute[75095]:         <nova:port uuid="154c8d2a-f72d-4484-bd0d-d0356c160349">
Nov 15 16:13:18 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 16:13:18 user nova-compute[75095]:         </nova:port>
Nov 15 16:13:18 user nova-compute[75095]:       </nova:ports>
Nov 15 16:13:18 user nova-compute[75095]:     </nova:instance>
Nov 15 16:13:18 user nova-compute[75095]:   </metadata>
Nov 15 16:13:18 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:13:18 user nova-compute[75095]:     <system>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="serial">8cd1eff7-5913-4343-a629-e7c752c14e00</entry>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="uuid">8cd1eff7-5913-4343-a629-e7c752c14e00</entry>
Nov 15 16:13:18 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:13:18 user nova-compute[75095]:     </system>
Nov 15 16:13:18 user nova-compute[75095]:   </sysinfo>
Nov 15 16:13:18 user nova-compute[75095]:   <os>
Nov 15 16:13:18 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:13:18 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:13:18 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:13:18 user nova-compute[75095]:   </os>
Nov 15 16:13:18 user nova-compute[75095]:   <features>
Nov 15 16:13:18 user nova-compute[75095]:     <acpi/>
Nov 15 16:13:18 user nova-compute[75095]:     <apic/>
Nov 15 16:13:18 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:13:18 user nova-compute[75095]:   </features>
Nov 15 16:13:18 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:13:18 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:13:18 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:13:18 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:13:18 user nova-compute[75095]:   </clock>
Nov 15 16:13:18 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:13:18 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:13:18 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:13:18 user nova-compute[75095]:   </cpu>
Nov 15 16:13:18 user nova-compute[75095]:   <devices>
Nov 15 16:13:18 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:13:18 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:13:18 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk"/>
Nov 15 16:13:18 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:13:18 user nova-compute[75095]:     </disk>
Nov 15 16:13:18 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:13:18 user nova-compute[75095]:       <mac address="fa:16:3e:d4:75:c3"/>
Nov 15 16:13:18 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:13:18 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:13:18 user nova-compute[75095]:       <target dev="tap154c8d2a-f7"/>
Nov 15 16:13:18 user nova-compute[75095]:     </interface>
Nov 15 16:13:18 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:13:18 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/console.log" append="off"/>
Nov 15 16:13:18 user nova-compute[75095]:     </serial>
Nov 15 16:13:18 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:13:18 user nova-compute[75095]:     <video>
Nov 15 16:13:18 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:13:18 user nova-compute[75095]:     </video>
Nov 15 16:13:18 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:13:18 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:13:18 user nova-compute[75095]:     </rng>
Nov 15 16:13:18 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:13:18 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:13:18 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:13:18 user nova-compute[75095]:     </memballoon>
Nov 15 16:13:18 user nova-compute[75095]:   </devices>
Nov 15 16:13:18 user nova-compute[75095]: </domain>
Nov 15 16:13:18 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='a863b580-57a8-4255-b3a2-68db99be730c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1567347712',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:09:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member',shelved_at='2023-11-15T16:11:22.945274',shelved_host='user',shelved_image_id='a863b580-57a8-4255-b3a2-68db99be730c'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:13:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG os_vif [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23075f95-d5b8-590c-885f-fae69f72be00', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap154c8d2a-f7, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap154c8d2a-f7, col_values=(('qos', UUID('98592ec2-5605-4800-8310-b6e9e9bb5c9e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap154c8d2a-f7, col_values=(('external_ids', {'iface-id': '154c8d2a-f72d-4484-bd0d-d0356c160349', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:75:c3', 'vm-uuid': '8cd1eff7-5913-4343-a629-e7c752c14e00'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:18 user nova-compute[75095]: INFO os_vif [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7')
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:13:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] No VIF found with MAC fa:16:3e:d4:75:c3, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:13:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG nova.compute.manager [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:20 user nova-compute[75095]: WARNING nova.compute.manager [req-7766ebe1-d903-49fc-8a9a-1214b251686e req-a73fffcd-971e-4ca5-b003-cb3073959ffa service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 16:13:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:13:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance spawned successfully.
Nov 15 16:13:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:22 user nova-compute[75095]: WARNING nova.compute.manager [req-e578087c-efcf-44da-8814-4bd861d160ad req-6e86d883-fed3-4993-8bb9-06db876a9413 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 16:13:22 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:13:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f793ef47-7e20-493b-904e-6c849c0cc577 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.652s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:23 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:23 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:13:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:32 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:13:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:13:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:13:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:13:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [{"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:13:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8fdc2842-a28c-4eaa-95c7-57c43dd864ea" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:13:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:13:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:35 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea is timed out.
Nov 15 16:13:35 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea from the live domain config.
Nov 15 16:13:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xlTucyLe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:13:35 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5223d21e-a096-49f4-8817-6c36912b1059]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:13:35 user nova-compute[75095]: No targets found.
Nov 15 16:13:35 user nova-compute[75095]: iSNS:
Nov 15 16:13:35 user nova-compute[75095]: No targets found.
Nov 15 16:13:35 user nova-compute[75095]: STATIC:
Nov 15 16:13:35 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a
Nov 15 16:13:35 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:13:35 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:13:35 user nova-compute[75095]: FIRMWARE:
Nov 15 16:13:35 user nova-compute[75095]: No targets found.
Nov 15 16:13:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:13:35 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:13:35 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ffb15b-6299-4038-87d8-6f919a686de1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c9ab0-f5c5-44bf-bce3-c9347a7cc939]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:13:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a (non-flash)
Nov 15 16:13:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c660790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23bf5c5-367b-420b-9411-b17a658a87ed]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb8e345-8b63-4c84-82ee-ce23ef48770d]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[662c0c79-a5fa-4d80-8849-27ceea68662e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4df61-5572-4f95-a298-482f14d376aa]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa13907-bc30-475c-b271-5b8af88ba709]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[624591c2-589a-4106-88ea-6bb4010f84ce]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260]
Nov 15 16:13:35 user nova-compute[75095]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a, portal: 172.16.0.220,3260] successful.
Nov 15 16:13:35 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e83b38b6-10a0-4031-8efd-8082a8336b3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb72e529-629a-4b9c-a30e-59cc2bc2a1ae]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== disconnect_volume: return (270ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:13:35 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:13:36 user nova-compute[75095]: DEBUG nova.objects.instance [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-25fddf9f-fb78-4388-b4f6-c7986d7a8f31 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.721s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:13:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:13:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:13:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:13:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=24.263423919677734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 943efe10-62c6-4e07-a980-0f9d668eb9a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8cd1eff7-5913-4343-a629-e7c752c14e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:13:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.447s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:48 user nova-compute[75095]: INFO nova.compute.manager [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Terminating instance
Nov 15 16:13:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-900bcea4-db77-46bd-b194-98186a8dadf6 req-57d699bd-afd8-4de6-958f-5ddef3d9dfcc service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Instance destroyed successfully.
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lazy-loading 'resources' on Instance uuid 943efe10-62c6-4e07-a980-0f9d668eb9a9 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-826767005',display_name='tempest-TestMinimumBasicScenario-server-826767005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-826767005',id=45,image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfepHLFzknpiTUKy7/tqkhzaEi3qSfL+mnvJaJg6cBpMjXEpQh1tHYwnoJUIoEPbRPIxLqYbQiNlTqvDuW41fk2BB6/8rAsWFamKobRhwD0xcvA0pl2UWlHlSHP7g/9bw==',key_name='tempest-TestMinimumBasicScenario-2049271884',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:09:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56e3ee465fc544fe81da6ef40da50d48',ramdisk_id='',reservation_id='r-9cknjy01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='30766bc3-1312-410d-97ad-8eb6a881dbef',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-844854400',owner_user_name='tempest-TestMinimumBasicScenario-844854400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:11:09Z,user_data=None,user_id='ae4c178bfe944f58a004a7f15795121b',uuid=943efe10-62c6-4e07-a980-0f9d668eb9a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converting VIF {"id": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "address": "fa:16:3e:16:59:43", "network": {"id": "80fac539-d1db-45c6-bcea-b65e30c8371b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-616181668-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56e3ee465fc544fe81da6ef40da50d48", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3fb8ae5-df", "ovs_interfaceid": "e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG os_vif [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3fb8ae5-df, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7508aeb-8226-41cf-b20d-9b349fe99e86) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:49 user nova-compute[75095]: INFO os_vif [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:59:43,bridge_name='br-int',has_traffic_filtering=True,id=e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0,network=Network(80fac539-d1db-45c6-bcea-b65e30c8371b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3fb8ae5-df')
Nov 15 16:13:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Deleting instance files /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9_del
Nov 15 16:13:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Deletion of /opt/stack/data/nova/instances/943efe10-62c6-4e07-a980-0f9d668eb9a9_del complete
Nov 15 16:13:49 user nova-compute[75095]: INFO nova.compute.manager [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 16:13:49 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:13:49 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:13:50 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Took 0.98 seconds to deallocate network for instance.
Nov 15 16:13:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-6246c9ba-118d-4c26-9707-746b28e91323 req-403ab8fc-89fb-4720-a209-8d9c1cce8396 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-deleted-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:13:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Deleted allocations for instance 943efe10-62c6-4e07-a980-0f9d668eb9a9
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:51 user nova-compute[75095]: WARNING nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state deleted and task_state None.
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:51 user nova-compute[75095]: WARNING nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state deleted and task_state None.
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:51 user nova-compute[75095]: WARNING nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state deleted and task_state None.
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:51 user nova-compute[75095]: WARNING nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-unplugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state deleted and task_state None.
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Acquiring lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] No waiting events found dispatching network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:13:51 user nova-compute[75095]: WARNING nova.compute.manager [req-1f222ec5-3939-430c-9a35-ad37a0db6d6b req-b614c6d8-8f16-40d3-8ee8-73c136c7d275 service nova] [instance: 943efe10-62c6-4e07-a980-0f9d668eb9a9] Received unexpected event network-vif-plugged-e3fb8ae5-df7a-461a-a46d-a7d48b5b5ca0 for instance with vm_state deleted and task_state None.
Nov 15 16:13:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8daa9e6e-b719-4855-b1d8-fd40653b208b tempest-TestMinimumBasicScenario-844854400 tempest-TestMinimumBasicScenario-844854400-project-member] Lock "943efe10-62c6-4e07-a980-0f9d668eb9a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:13:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:13:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:04 user nova-compute[75095]: INFO nova.compute.manager [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Terminating instance
Nov 15 16:14:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-unplugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] No waiting events found dispatching network-vif-unplugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-01e2cf73-c72f-49ed-8c09-89c6c047ba5e req-18bda840-5e09-4337-b4b5-01b48a07c3fd service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-unplugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:14:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Instance destroyed successfully.
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'resources' on Instance uuid 8fdc2842-a28c-4eaa-95c7-57c43dd864ea {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:08:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-869441188',display_name='tempest-AttachVolumeNegativeTest-server-869441188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-869441188',id=44,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpLYeg6CbbN7oiY6VHDchSusoQ17FUyCObvBUtj4MRZsC37/9Ev6bX78CHos8atCFsz/E4Q4s2+P66epgkPW/TnCTa2qmPQ40fiJQDAVx+xvrvzBgGQ8kPOsaYWPC4EYQ==',key_name='tempest-keypair-1023059094',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-o7azntrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:08:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8fdc2842-a28c-4eaa-95c7-57c43dd864ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "address": "fa:16:3e:20:38:ab", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c1f2a50-0b", "ovs_interfaceid": "7c1f2a50-0b97-4c68-becf-46f0e0c6aa25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG os_vif [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c1f2a50-0b, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=008ce679-91ab-44d9-af74-ed781e216594) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:05 user nova-compute[75095]: INFO os_vif [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:38:ab,bridge_name='br-int',has_traffic_filtering=True,id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c1f2a50-0b')
Nov 15 16:14:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Deleting instance files /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea_del
Nov 15 16:14:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Deletion of /opt/stack/data/nova/instances/8fdc2842-a28c-4eaa-95c7-57c43dd864ea_del complete
Nov 15 16:14:05 user nova-compute[75095]: INFO nova.compute.manager [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 16:14:05 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:14:05 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:14:06 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Took 0.73 seconds to deallocate network for instance.
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-4726394a-d415-41a4-94ac-f5d10f7f837e req-ad244f1a-2771-471b-8dc5-7de3ddbb1154 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-deleted-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:14:06 user nova-compute[75095]: INFO nova.compute.manager [req-4726394a-d415-41a4-94ac-f5d10f7f837e req-ad244f1a-2771-471b-8dc5-7de3ddbb1154 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Neutron deleted interface 7c1f2a50-0b97-4c68-becf-46f0e0c6aa25; detaching it from the instance and deleting it from the info cache
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.network.neutron [req-4726394a-d415-41a4-94ac-f5d10f7f837e req-ad244f1a-2771-471b-8dc5-7de3ddbb1154 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.compute.manager [req-4726394a-d415-41a4-94ac-f5d10f7f837e req-ad244f1a-2771-471b-8dc5-7de3ddbb1154 service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Detach interface failed, port_id=7c1f2a50-0b97-4c68-becf-46f0e0c6aa25, reason: Instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:14:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:06 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Deleted allocations for instance 8fdc2842-a28c-4eaa-95c7-57c43dd864ea
Nov 15 16:14:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-ce054943-f707-4664-a1a2-e05d3230b55e tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.713s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:14:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] Acquiring lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] Lock "8fdc2842-a28c-4eaa-95c7-57c43dd864ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:07 user nova-compute[75095]: DEBUG nova.compute.manager [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] No waiting events found dispatching network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:14:07 user nova-compute[75095]: WARNING nova.compute.manager [req-4a999063-3b01-46a2-badb-62bee938eeca req-e6268465-bc35-4197-a2ee-d19d5d8f355d service nova] [instance: 8fdc2842-a28c-4eaa-95c7-57c43dd864ea] Received unexpected event network-vif-plugged-7c1f2a50-0b97-4c68-becf-46f0e0c6aa25 for instance with vm_state deleted and task_state None.
Nov 15 16:14:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:14:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:14:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:32 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:14:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:14:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:14:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:40 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'info_cache' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:14:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance destroyed successfully.
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'resources' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG os_vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b9a48d-68, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88f666d3-205a-4ac7-837c-33061749a7dc) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:47 user nova-compute[75095]: INFO os_vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start _get_guest_xml network_info=[{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'numa_topology' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:14:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'vcpu_model' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'pci_devices' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:14:47 user nova-compute[75095]:   <uuid>08918122-86d9-40c8-8a72-046aba3a3fc6</uuid>
Nov 15 16:14:47 user nova-compute[75095]:   <name>instance-0000002b</name>
Nov 15 16:14:47 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:14:47 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:14:47 user nova-compute[75095]:   <metadata>
Nov 15 16:14:47 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:14:47 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeTestJSON-server-697539317</nova:name>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:14:47</nova:creationTime>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:14:47 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:14:47 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:owner>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:user uuid="affac16301c14d9bb758222765b5f600">tempest-AttachVolumeTestJSON-640760510-project-member</nova:user>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:project uuid="56b8acac89af43a2a6c63b27f6d56528">tempest-AttachVolumeTestJSON-640760510</nova:project>
Nov 15 16:14:47 user nova-compute[75095]:       </nova:owner>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:14:47 user nova-compute[75095]:       <nova:ports>
Nov 15 16:14:47 user nova-compute[75095]:         <nova:port uuid="01b9a48d-6824-42df-b799-8b229992efee">
Nov 15 16:14:47 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 16:14:47 user nova-compute[75095]:         </nova:port>
Nov 15 16:14:47 user nova-compute[75095]:       </nova:ports>
Nov 15 16:14:47 user nova-compute[75095]:     </nova:instance>
Nov 15 16:14:47 user nova-compute[75095]:   </metadata>
Nov 15 16:14:47 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:14:47 user nova-compute[75095]:     <system>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="serial">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="uuid">08918122-86d9-40c8-8a72-046aba3a3fc6</entry>
Nov 15 16:14:47 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:14:47 user nova-compute[75095]:     </system>
Nov 15 16:14:47 user nova-compute[75095]:   </sysinfo>
Nov 15 16:14:47 user nova-compute[75095]:   <os>
Nov 15 16:14:47 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:14:47 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:14:47 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:14:47 user nova-compute[75095]:   </os>
Nov 15 16:14:47 user nova-compute[75095]:   <features>
Nov 15 16:14:47 user nova-compute[75095]:     <acpi/>
Nov 15 16:14:47 user nova-compute[75095]:     <apic/>
Nov 15 16:14:47 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:14:47 user nova-compute[75095]:   </features>
Nov 15 16:14:47 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:14:47 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:14:47 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:14:47 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:14:47 user nova-compute[75095]:   </clock>
Nov 15 16:14:47 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:14:47 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:14:47 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:14:47 user nova-compute[75095]:   </cpu>
Nov 15 16:14:47 user nova-compute[75095]:   <devices>
Nov 15 16:14:47 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:14:47 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:14:47 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk"/>
Nov 15 16:14:47 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:14:47 user nova-compute[75095]:     </disk>
Nov 15 16:14:47 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:14:47 user nova-compute[75095]:       <mac address="fa:16:3e:b5:79:da"/>
Nov 15 16:14:47 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:14:47 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:14:47 user nova-compute[75095]:       <target dev="tap01b9a48d-68"/>
Nov 15 16:14:47 user nova-compute[75095]:     </interface>
Nov 15 16:14:47 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:14:47 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/console.log" append="off"/>
Nov 15 16:14:47 user nova-compute[75095]:     </serial>
Nov 15 16:14:47 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:14:47 user nova-compute[75095]:     <video>
Nov 15 16:14:47 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:14:47 user nova-compute[75095]:     </video>
Nov 15 16:14:47 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:14:47 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:14:47 user nova-compute[75095]:     </rng>
Nov 15 16:14:47 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:14:47 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:14:47 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:14:47 user nova-compute[75095]:     </memballoon>
Nov 15 16:14:47 user nova-compute[75095]:   </devices>
Nov 15 16:14:47 user nova-compute[75095]: </domain>
Nov 15 16:14:47 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'trusted_certs' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:14:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.357826232910156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8cd1eff7-5913-4343-a629-e7c752c14e00 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.201s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Cannot resize image /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'migration_context' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.objects.base [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Object Instance<08918122-86d9-40c8-8a72-046aba3a3fc6> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG os_vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e37dde8-caa3-51d5-969b-c4f3187ef3f5', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b9a48d-68, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b9a48d-68, col_values=(('qos', UUID('66ea894e-21a1-45e1-9432-5e2c47749110')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b9a48d-68, col_values=(('external_ids', {'iface-id': '01b9a48d-6824-42df-b799-8b229992efee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:79:da', 'vm-uuid': '08918122-86d9-40c8-8a72-046aba3a3fc6'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:14:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:48 user nova-compute[75095]: INFO os_vif [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:14:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:14:49 user nova-compute[75095]: WARNING nova.compute.manager [req-33959d5a-e533-4f92-a4b9-533eec97d527 req-35e9d5f0-6ff3-4350-bbf2-768f011a8acc service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state stopped and task_state powering-on.
Nov 15 16:14:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:14:51 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance rebooted successfully.
Nov 15 16:14:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-d614f79e-6601-4bdf-ac17-b44639fdcc71 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:14:51 user nova-compute[75095]: WARNING nova.compute.manager [req-acb1c1e5-0e54-4ee1-9cbe-233a1db5a992 req-d0d4b77f-4f4f-4e9c-92a6-44843309df1c service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state active and task_state None.
Nov 15 16:14:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:14:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:14:58 user nova-compute[75095]: INFO nova.compute.claims [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Claim successful on node user
Nov 15 16:14:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:14:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.policy [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c77613061a8c475087e49aedec4a9bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228614fdcc87477786a1c9c97b366eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:14:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Creating image(s)
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:58 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.215s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk 1073741824" returned: 0 in 0.058s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Successfully created port: 797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Cannot resize image /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Ensure instance console log exists: /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:14:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Successfully updated port: 797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquired lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-changed-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.compute.manager [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Refreshing instance network info cache due to event network-changed-797d4c83-6f43-4fb4-ac4f-988e3a0cab32. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] Acquiring lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Releasing lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Instance network_info: |[{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] Acquired lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Refreshing network info cache for port 797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Start _get_guest_xml network_info=[{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:15:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:15:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1390715965',display_name='tempest-AttachVolumeNegativeTest-server-1390715965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1390715965',id=48,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJvgwOEBtOr4FGuJlIklIQKm3OfkIWvUQ6WKkH4golnOeSUymISs3o5y6hYH5HWI7K/ncLUl2tHiOWsgctdLeIUoeTTW/nwl17cN4Q2Pb9DfJ810Po5JwulHYRhesVjyw==',key_name='tempest-keypair-1540796342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-h261k56e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'pci_devices' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:15:00 user nova-compute[75095]:   <uuid>f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b</uuid>
Nov 15 16:15:00 user nova-compute[75095]:   <name>instance-00000030</name>
Nov 15 16:15:00 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:15:00 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:15:00 user nova-compute[75095]:   <metadata>
Nov 15 16:15:00 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:15:00 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1390715965</nova:name>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:15:00</nova:creationTime>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:15:00 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:15:00 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:owner>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:user uuid="c77613061a8c475087e49aedec4a9bd0">tempest-AttachVolumeNegativeTest-677596313-project-member</nova:user>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:project uuid="228614fdcc87477786a1c9c97b366eeb">tempest-AttachVolumeNegativeTest-677596313</nova:project>
Nov 15 16:15:00 user nova-compute[75095]:       </nova:owner>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:15:00 user nova-compute[75095]:       <nova:ports>
Nov 15 16:15:00 user nova-compute[75095]:         <nova:port uuid="797d4c83-6f43-4fb4-ac4f-988e3a0cab32">
Nov 15 16:15:00 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 16:15:00 user nova-compute[75095]:         </nova:port>
Nov 15 16:15:00 user nova-compute[75095]:       </nova:ports>
Nov 15 16:15:00 user nova-compute[75095]:     </nova:instance>
Nov 15 16:15:00 user nova-compute[75095]:   </metadata>
Nov 15 16:15:00 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:15:00 user nova-compute[75095]:     <system>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="serial">f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b</entry>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="uuid">f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b</entry>
Nov 15 16:15:00 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:15:00 user nova-compute[75095]:     </system>
Nov 15 16:15:00 user nova-compute[75095]:   </sysinfo>
Nov 15 16:15:00 user nova-compute[75095]:   <os>
Nov 15 16:15:00 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:15:00 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:15:00 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:15:00 user nova-compute[75095]:   </os>
Nov 15 16:15:00 user nova-compute[75095]:   <features>
Nov 15 16:15:00 user nova-compute[75095]:     <acpi/>
Nov 15 16:15:00 user nova-compute[75095]:     <apic/>
Nov 15 16:15:00 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:15:00 user nova-compute[75095]:   </features>
Nov 15 16:15:00 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:15:00 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:15:00 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:15:00 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:15:00 user nova-compute[75095]:   </clock>
Nov 15 16:15:00 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:15:00 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:15:00 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:15:00 user nova-compute[75095]:   </cpu>
Nov 15 16:15:00 user nova-compute[75095]:   <devices>
Nov 15 16:15:00 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:15:00 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:15:00 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk"/>
Nov 15 16:15:00 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:15:00 user nova-compute[75095]:     </disk>
Nov 15 16:15:00 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:15:00 user nova-compute[75095]:       <mac address="fa:16:3e:b0:d6:b1"/>
Nov 15 16:15:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:15:00 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:15:00 user nova-compute[75095]:       <target dev="tap797d4c83-6f"/>
Nov 15 16:15:00 user nova-compute[75095]:     </interface>
Nov 15 16:15:00 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:15:00 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/console.log" append="off"/>
Nov 15 16:15:00 user nova-compute[75095]:     </serial>
Nov 15 16:15:00 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:15:00 user nova-compute[75095]:     <video>
Nov 15 16:15:00 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:15:00 user nova-compute[75095]:     </video>
Nov 15 16:15:00 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:15:00 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:15:00 user nova-compute[75095]:     </rng>
Nov 15 16:15:00 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:15:00 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:15:00 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:15:00 user nova-compute[75095]:     </memballoon>
Nov 15 16:15:00 user nova-compute[75095]:   </devices>
Nov 15 16:15:00 user nova-compute[75095]: </domain>
Nov 15 16:15:00 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1390715965',display_name='tempest-AttachVolumeNegativeTest-server-1390715965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1390715965',id=48,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJvgwOEBtOr4FGuJlIklIQKm3OfkIWvUQ6WKkH4golnOeSUymISs3o5y6hYH5HWI7K/ncLUl2tHiOWsgctdLeIUoeTTW/nwl17cN4Q2Pb9DfJ810Po5JwulHYRhesVjyw==',key_name='tempest-keypair-1540796342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-h261k56e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:14:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG os_vif [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce06a205-149a-5a70-8e34-3b0d7fc1f64e', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap797d4c83-6f, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap797d4c83-6f, col_values=(('qos', UUID('bf253359-360f-4047-ba66-3992b1c81e21')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap797d4c83-6f, col_values=(('external_ids', {'iface-id': '797d4c83-6f43-4fb4-ac4f-988e3a0cab32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:d6:b1', 'vm-uuid': 'f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:00 user nova-compute[75095]: INFO os_vif [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f')
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:b0:d6:b1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updated VIF entry in instance network info cache for port 797d4c83-6f43-4fb4-ac4f-988e3a0cab32. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG nova.network.neutron [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:15:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b05a59d3-c0b2-45ca-8ba1-2a9a08b12017 req-a7eecf8b-4c59-4111-a918-35f48bac55a1 service nova] Releasing lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:15:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:02 user nova-compute[75095]: INFO nova.compute.manager [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Terminating instance
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] No waiting events found dispatching network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:15:02 user nova-compute[75095]: WARNING nova.compute.manager [req-c85d20ce-1abf-4623-8ffe-7feff877a801 req-178ee29b-07e7-4378-839e-0b81531bd470 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received unexpected event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 for instance with vm_state building and task_state spawning.
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [req-f9d40b1e-ada6-47ed-a94a-07221c4b01e2 req-9c5620e6-991f-4dc5-ab86-e2a4049975f9 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-unplugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Instance destroyed successfully.
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lazy-loading 'resources' on Instance uuid 8cd1eff7-5913-4343-a629-e7c752c14e00 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:09:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1567237612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1567237612',id=46,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmMvHV8xDHklDPhW8XA494wktzZ26sW0jawVZ6ypfLr42e2sDo/CVJaTHgzJr3Lmx+1TL9N23KjLdZHduXKBE9y8C0xIwONoTzF3jtBkkyhFrHHAHzIxscSVSEjCZeXfA==',key_name='tempest-keypair-1567347712',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:13:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='61d11880351b4cb6b30085b160c4a460',ramdisk_id='',reservation_id='r-ehf0ridx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1599642998',owner_user_name='tempest-AttachVolumeShelveTestJSON-1599642998-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:13:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bac844ae1f345e79e89acb0cfc8c4d8',uuid=8cd1eff7-5913-4343-a629-e7c752c14e00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converting VIF {"id": "154c8d2a-f72d-4484-bd0d-d0356c160349", "address": "fa:16:3e:d4:75:c3", "network": {"id": "807e8c49-4fd8-4028-9c9e-ad81909ba9d9", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-39186799-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "61d11880351b4cb6b30085b160c4a460", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154c8d2a-f7", "ovs_interfaceid": "154c8d2a-f72d-4484-bd0d-d0356c160349", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG os_vif [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap154c8d2a-f7, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98592ec2-5605-4800-8310-b6e9e9bb5c9e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:02 user nova-compute[75095]: INFO os_vif [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:c3,bridge_name='br-int',has_traffic_filtering=True,id=154c8d2a-f72d-4484-bd0d-d0356c160349,network=Network(807e8c49-4fd8-4028-9c9e-ad81909ba9d9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap154c8d2a-f7')
Nov 15 16:15:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Deleting instance files /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00_del
Nov 15 16:15:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Deletion of /opt/stack/data/nova/instances/8cd1eff7-5913-4343-a629-e7c752c14e00_del complete
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:02 user nova-compute[75095]: INFO nova.compute.manager [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 15 16:15:02 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:15:02 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:15:03 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:15:03 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Took 0.88 seconds to deallocate network for instance.
Nov 15 16:15:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:15:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:04 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Deleted allocations for instance 8cd1eff7-5913-4343-a629-e7c752c14e00
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-fbb93051-813d-46e2-80a9-4bcf0e264887 tempest-AttachVolumeShelveTestJSON-1599642998 tempest-AttachVolumeShelveTestJSON-1599642998-project-member] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] No waiting events found dispatching network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:15:04 user nova-compute[75095]: WARNING nova.compute.manager [req-233acc78-38d2-4fd1-8a0e-9aa663da719d req-0e02836f-d936-4ff7-87f4-371c215f2958 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received unexpected event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 for instance with vm_state building and task_state spawning.
Nov 15 16:15:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:15:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Instance spawned successfully.
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:15:04 user nova-compute[75095]: INFO nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Took 5.80 seconds to spawn the instance on the hypervisor.
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] Acquiring lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] Lock "8cd1eff7-5913-4343-a629-e7c752c14e00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] No waiting events found dispatching network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:15:04 user nova-compute[75095]: WARNING nova.compute.manager [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received unexpected event network-vif-plugged-154c8d2a-f72d-4484-bd0d-d0356c160349 for instance with vm_state deleted and task_state None.
Nov 15 16:15:04 user nova-compute[75095]: DEBUG nova.compute.manager [req-dfbd7c91-1b23-4046-bec6-1451e601dd48 req-c0423985-8a28-461c-96c9-e1917163a934 service nova] [instance: 8cd1eff7-5913-4343-a629-e7c752c14e00] Received event network-vif-deleted-154c8d2a-f72d-4484-bd0d-d0356c160349 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:15:04 user nova-compute[75095]: INFO nova.compute.manager [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Took 6.53 seconds to build instance.
Nov 15 16:15:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e26234fb-81d0-4bde-95d3-29d0f11ce234 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.615s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:15:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [{"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:15:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-08918122-86d9-40c8-8a72-046aba3a3fc6" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:15:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:15:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:15:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:15:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:15:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:15:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=24.347400665283203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:15:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 08918122-86d9-40c8-8a72-046aba3a3fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:15:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.225s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:15:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:15:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:15:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:16:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:16:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:16:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:16:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:37 user nova-compute[75095]: INFO nova.compute.manager [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Terminating instance
Nov 15 16:16:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-145df1c4-c8f6-471a-84a6-1507f7c908f8 req-4212a33c-8d1c-4271-93fa-324791bea63a service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-unplugged-01b9a48d-6824-42df-b799-8b229992efee for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:16:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Instance destroyed successfully.
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.objects.instance [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'resources' on Instance uuid 08918122-86d9-40c8-8a72-046aba3a3fc6 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:06:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-697539317',display_name='tempest-AttachVolumeTestJSON-server-697539317',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-697539317',id=43,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKl5L3z5GjwdTm3tFopjTV/7UCxQlX1swdSDDqEHQKFz/l10hCz7KEXKjfPQSS2neSdUi1PpmAA8vwzBkCVvHzxyptRa8KjFl515XnD7xPPmHHOXm2dGNNWE+o/8gQ5vA==',key_name='tempest-keypair-1979277546',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:06:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-tmnrca9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:14:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=08918122-86d9-40c8-8a72-046aba3a3fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "01b9a48d-6824-42df-b799-8b229992efee", "address": "fa:16:3e:b5:79:da", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b9a48d-68", "ovs_interfaceid": "01b9a48d-6824-42df-b799-8b229992efee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG os_vif [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b9a48d-68, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66ea894e-21a1-45e1-9432-5e2c47749110) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:38 user nova-compute[75095]: INFO os_vif [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b5:79:da,bridge_name='br-int',has_traffic_filtering=True,id=01b9a48d-6824-42df-b799-8b229992efee,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b9a48d-68')
Nov 15 16:16:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Deleting instance files /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6_del
Nov 15 16:16:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Deletion of /opt/stack/data/nova/instances/08918122-86d9-40c8-8a72-046aba3a3fc6_del complete
Nov 15 16:16:38 user nova-compute[75095]: INFO nova.compute.manager [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 16:16:38 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:16:38 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:16:39 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Took 0.70 seconds to deallocate network for instance.
Nov 15 16:16:39 user nova-compute[75095]: DEBUG nova.compute.manager [req-0ce086b2-e455-481e-b514-6cedb25c4717 req-9c124dc7-38eb-404c-b043-0a0c13fa5ab6 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-deleted-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:39 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Deleted allocations for instance 08918122-86d9-40c8-8a72-046aba3a3fc6
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a1018b9a-6bde-4e9c-ae95-45f4d5144f80 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.672s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:16:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:16:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] Acquiring lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] Lock "08918122-86d9-40c8-8a72-046aba3a3fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:40 user nova-compute[75095]: DEBUG nova.compute.manager [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] No waiting events found dispatching network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:16:40 user nova-compute[75095]: WARNING nova.compute.manager [req-d77d1ed8-2477-41fd-b773-97330bcbb493 req-3e5286a0-c811-42e3-a634-44a11aab4213 service nova] [instance: 08918122-86d9-40c8-8a72-046aba3a3fc6] Received unexpected event network-vif-plugged-01b9a48d-6824-42df-b799-8b229992efee for instance with vm_state deleted and task_state None.
Nov 15 16:16:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:16:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=24.37411117553711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:16:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-changed-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Refreshing instance network info cache due to event network-changed-797d4c83-6f43-4fb4-ac4f-988e3a0cab32. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] Acquiring lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] Acquired lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Refreshing network info cache for port 797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updated VIF entry in instance network info cache for port 797d4c83-6f43-4fb4-ac4f-988e3a0cab32. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:16:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2c37add5-abcf-4351-a5af-54288fa6b16c req-1211b560-05fe-412a-8035-7a9f4fb2b818 service nova] Releasing lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:50 user nova-compute[75095]: INFO nova.compute.manager [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Attaching volume 76e198cd-410d-4d03-8dd5-873460ae8185 to /dev/vdb
Nov 15 16:16:50 user nova-compute[75095]: DEBUG os_brick.utils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:16:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[862062b7-9fcd-4b77-81f3-904e49df06c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c366b-082f-4158-887e-a06b14a0a348]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f02d04-7f3c-46aa-9242-1a9ec6b21e35]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c393e074-53a1-472b-bed9-e2f5bc81f99f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:16:51 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:16:51 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b29484-bcce-4480-a318-74f11301e1e2]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG os_brick.utils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:16:51 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating existing volume attachment record: c959d76d-4ff7-4bf0-a3f2-a2e02fee62fb {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:16:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:16:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwjhXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:16:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:16:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:16:55 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9fc7f-51c6-42f6-a535-124253b1f216]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:16:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[55392714-b86d-4dcf-b561-46640c1ee491]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185] added
Nov 15 16:16:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a11aa5-71e1-4874-81f5-5b0d6d973ea8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f95c18-5e69-4b9c-975d-5b56f8247ab2]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNOwjhXo {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kNOwjhXo" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db570e8-b7fb-42a5-8805-0f1fa43792a4]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kNOwjhXo'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab9da19-ac55-4e01-a9e5-a5d949ed1b57]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e8f1f-f806-403f-937e-4eb531e88b13]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:16:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:16:55 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:16:55 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:16:55 user nova-compute[75095]: 
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ae92a2-2e51-441f-8862-7d60305d8cae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260]
Nov 15 16:16:55 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260] successful.
Nov 15 16:16:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[950348bf-187c-439f-8b68-57bb2c87757b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f011d60a-296a-4800-971f-66927b3d267b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)
Nov 15 16:16:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)
Nov 15 16:16:55 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[93743607-5f91-4a4c-9dcd-1fdaec48c99d]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:16:55 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwjhXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26139623034636432', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139623034636432', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:16:56 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:16:56 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:16:56 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:16:56 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:16:56 user nova-compute[75095]:   <serial>76e198cd-410d-4d03-8dd5-873460ae8185</serial>
Nov 15 16:16:56 user nova-compute[75095]: </disk>
Nov 15 16:16:56 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:16:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:16:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:16:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:b0:d6:b1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:16:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0434fc31-4070-471f-9a18-585b6d5e07fb tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.534s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:16:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:16:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:16:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:16:58 user nova-compute[75095]: INFO nova.compute.manager [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Detaching volume 76e198cd-410d-4d03-8dd5-873460ae8185
Nov 15 16:16:58 user nova-compute[75095]: INFO nova.virt.block_device [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Attempting to driver detach volume 76e198cd-410d-4d03-8dd5-873460ae8185 from mountpoint /dev/vdb
Nov 15 16:16:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Attempting to detach device vdb from instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:16:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:16:58 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:16:58 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:16:58 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:16:58 user nova-compute[75095]:   <serial>76e198cd-410d-4d03-8dd5-873460ae8185</serial>
Nov 15 16:16:58 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:16:58 user nova-compute[75095]: </disk>
Nov 15 16:16:58 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:16:58 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b from the persistent domain config.
Nov 15 16:16:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:16:58 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:16:58 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:16:58 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:16:58 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:16:58 user nova-compute[75095]:   <serial>76e198cd-410d-4d03-8dd5-873460ae8185</serial>
Nov 15 16:16:58 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:16:58 user nova-compute[75095]: </disk>
Nov 15 16:16:58 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:16:59 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:16:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:19 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b is timed out.
Nov 15 16:17:19 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b from the live domain config.
Nov 15 16:17:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kNOwjhXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:17:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc8fcfe-f5ed-4743-9451-bed11b659f95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:17:19 user nova-compute[75095]: No targets found.
Nov 15 16:17:19 user nova-compute[75095]: iSNS:
Nov 15 16:17:19 user nova-compute[75095]: No targets found.
Nov 15 16:17:19 user nova-compute[75095]: STATIC:
Nov 15 16:17:19 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185
Nov 15 16:17:19 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:17:19 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:17:19 user nova-compute[75095]: FIRMWARE:
Nov 15 16:17:19 user nova-compute[75095]: No targets found.
Nov 15 16:17:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:17:19 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:17:19 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe0f785-fa4b-4db4-84aa-5fea26ac9361]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4f35a-cd58-4dad-8e79-9dbe38d2d079]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)
Nov 15 16:17:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 (non-flash)
Nov 15 16:17:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2ea5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd180946-f21f-4bcc-8cec-b55e1c5881dd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e258dc7c-bc60-4b5f-8330-49b3d8c0ab45]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13e25b0-d369-43b2-9b8e-f9f6cde14006]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b9bf35-5354-4e30-bf21-cedefe10a3ad]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5597cf6-36e7-43e6-9142-c3a70e971170]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c2e30-7877-42c4-b7a1-9d68fb74f934]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260]
Nov 15 16:17:19 user nova-compute[75095]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185, portal: 172.16.0.220,3260] successful.
Nov 15 16:17:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:76e198cd-410d-4d03-8dd5-873460ae8185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d313477-2ce9-45b1-bd57-ae2cbd74d042]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== disconnect_volume: return (294ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:17:19 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:17:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:17:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5c098a5d-77ab-4328-b0e8-22239259f6b5 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.614s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:31 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:17:32 user nova-compute[75095]: INFO nova.compute.claims [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Claim successful on node user
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:17:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.policy [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'affac16301c14d9bb758222765b5f600', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56b8acac89af43a2a6c63b27f6d56528', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:17:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Creating image(s)
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "/opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "/opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "/opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk 1073741824" returned: 0 in 0.045s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:32 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Cannot resize image /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Ensure instance console log exists: /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Successfully created port: 4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:17:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Successfully updated port: 4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquired lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-changed-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Refreshing instance network info cache due to event network-changed-4bc047bd-cca5-4bb5-a428-543e5a29ad91. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] Acquiring lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Releasing lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Instance network_info: |[{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] Acquired lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Refreshing network info cache for port 4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Start _get_guest_xml network_info=[{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:17:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:17:34 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1264554240',display_name='tempest-AttachVolumeTestJSON-server-1264554240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1264554240',id=49,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULM/Zj7KAxy8PvrIoHDRqYY8C+ft4hGAx36pZkn3eF05RMCRZfytk0pGws4nAyFJMHbIIWL6iSIG5maOD4c0tzbocRQa72UMb23JhdcE5pXz/eC22Q0vh9Bz9H5One0Q==',key_name='tempest-keypair-107407332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-olkz2l9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=e40732cc-a9f8-4c50-9f91-441442a9b170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'pci_devices' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:17:34 user nova-compute[75095]:   <uuid>e40732cc-a9f8-4c50-9f91-441442a9b170</uuid>
Nov 15 16:17:34 user nova-compute[75095]:   <name>instance-00000031</name>
Nov 15 16:17:34 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:17:34 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:17:34 user nova-compute[75095]:   <metadata>
Nov 15 16:17:34 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:17:34 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeTestJSON-server-1264554240</nova:name>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:17:34</nova:creationTime>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:17:34 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:17:34 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:owner>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:user uuid="affac16301c14d9bb758222765b5f600">tempest-AttachVolumeTestJSON-640760510-project-member</nova:user>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:project uuid="56b8acac89af43a2a6c63b27f6d56528">tempest-AttachVolumeTestJSON-640760510</nova:project>
Nov 15 16:17:34 user nova-compute[75095]:       </nova:owner>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:17:34 user nova-compute[75095]:       <nova:ports>
Nov 15 16:17:34 user nova-compute[75095]:         <nova:port uuid="4bc047bd-cca5-4bb5-a428-543e5a29ad91">
Nov 15 16:17:34 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 16:17:34 user nova-compute[75095]:         </nova:port>
Nov 15 16:17:34 user nova-compute[75095]:       </nova:ports>
Nov 15 16:17:34 user nova-compute[75095]:     </nova:instance>
Nov 15 16:17:34 user nova-compute[75095]:   </metadata>
Nov 15 16:17:34 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:17:34 user nova-compute[75095]:     <system>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="serial">e40732cc-a9f8-4c50-9f91-441442a9b170</entry>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="uuid">e40732cc-a9f8-4c50-9f91-441442a9b170</entry>
Nov 15 16:17:34 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:17:34 user nova-compute[75095]:     </system>
Nov 15 16:17:34 user nova-compute[75095]:   </sysinfo>
Nov 15 16:17:34 user nova-compute[75095]:   <os>
Nov 15 16:17:34 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:17:34 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:17:34 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:17:34 user nova-compute[75095]:   </os>
Nov 15 16:17:34 user nova-compute[75095]:   <features>
Nov 15 16:17:34 user nova-compute[75095]:     <acpi/>
Nov 15 16:17:34 user nova-compute[75095]:     <apic/>
Nov 15 16:17:34 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:17:34 user nova-compute[75095]:   </features>
Nov 15 16:17:34 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:17:34 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:17:34 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:17:34 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:17:34 user nova-compute[75095]:   </clock>
Nov 15 16:17:34 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:17:34 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:17:34 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:17:34 user nova-compute[75095]:   </cpu>
Nov 15 16:17:34 user nova-compute[75095]:   <devices>
Nov 15 16:17:34 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:17:34 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:17:34 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk"/>
Nov 15 16:17:34 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:17:34 user nova-compute[75095]:     </disk>
Nov 15 16:17:34 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:17:34 user nova-compute[75095]:       <mac address="fa:16:3e:ca:9a:a7"/>
Nov 15 16:17:34 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:17:34 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:17:34 user nova-compute[75095]:       <target dev="tap4bc047bd-cc"/>
Nov 15 16:17:34 user nova-compute[75095]:     </interface>
Nov 15 16:17:34 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:17:34 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/console.log" append="off"/>
Nov 15 16:17:34 user nova-compute[75095]:     </serial>
Nov 15 16:17:34 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:17:34 user nova-compute[75095]:     <video>
Nov 15 16:17:34 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:17:34 user nova-compute[75095]:     </video>
Nov 15 16:17:34 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:17:34 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:17:34 user nova-compute[75095]:     </rng>
Nov 15 16:17:34 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:17:34 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:17:34 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:17:34 user nova-compute[75095]:     </memballoon>
Nov 15 16:17:34 user nova-compute[75095]:   </devices>
Nov 15 16:17:34 user nova-compute[75095]: </domain>
Nov 15 16:17:34 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1264554240',display_name='tempest-AttachVolumeTestJSON-server-1264554240',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1264554240',id=49,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULM/Zj7KAxy8PvrIoHDRqYY8C+ft4hGAx36pZkn3eF05RMCRZfytk0pGws4nAyFJMHbIIWL6iSIG5maOD4c0tzbocRQa72UMb23JhdcE5pXz/eC22Q0vh9Bz9H5One0Q==',key_name='tempest-keypair-107407332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-olkz2l9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:17:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=e40732cc-a9f8-4c50-9f91-441442a9b170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG os_vif [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2934459a-a45a-5df3-8ee2-974edb1a94c1', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4bc047bd-cc, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4bc047bd-cc, col_values=(('qos', UUID('98bddff8-c9d6-448d-a257-d292946e5a3e')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4bc047bd-cc, col_values=(('external_ids', {'iface-id': '4bc047bd-cca5-4bb5-a428-543e5a29ad91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:9a:a7', 'vm-uuid': 'e40732cc-a9f8-4c50-9f91-441442a9b170'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:34 user nova-compute[75095]: INFO os_vif [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc')
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No VIF found with MAC fa:16:3e:ca:9a:a7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updated VIF entry in instance network info cache for port 4bc047bd-cca5-4bb5-a428-543e5a29ad91. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:17:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-5aa4ca97-7b0b-474b-83f2-10f6b683dd6e req-ef7d34da-4b71-4e79-a2a1-6b5954974b73 service nova] Releasing lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:17:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] No waiting events found dispatching network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:17:36 user nova-compute[75095]: WARNING nova.compute.manager [req-fed7eeb0-70b8-4d64-b8ca-2194f0ba5b6a req-8ce62d20-58a4-4e0c-9dc3-fc12ce89bc3f service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received unexpected event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 for instance with vm_state building and task_state spawning.
Nov 15 16:17:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Skipping network cache update for instance because it is Building. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:17:36 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:17:37 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [{"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:17:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:17:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:17:38 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Instance spawned successfully.
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.compute.manager [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] No waiting events found dispatching network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:17:38 user nova-compute[75095]: WARNING nova.compute.manager [req-552b8c5e-c396-43b6-a67c-814bae39cde6 req-db45890e-9a25-48e6-9fac-454e0089449e service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received unexpected event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 for instance with vm_state building and task_state spawning.
Nov 15 16:17:38 user nova-compute[75095]: INFO nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 15 16:17:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:17:38 user nova-compute[75095]: INFO nova.compute.manager [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Took 6.15 seconds to build instance.
Nov 15 16:17:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9337e4d7-ea46-4337-9416-32a29eac4e43 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.243s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:40 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:17:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:17:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:49 user nova-compute[75095]: INFO nova.compute.manager [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Terminating instance
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-unplugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] No waiting events found dispatching network-vif-unplugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:17:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-9a1122dc-37bb-4cb1-951a-42ff1f066256 req-80d75e11-0742-423c-8317-66d9201e357a service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-unplugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:50 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:17:50 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=24.345531463623047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Instance destroyed successfully.
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'resources' on Instance uuid f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:14:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1390715965',display_name='tempest-AttachVolumeNegativeTest-server-1390715965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1390715965',id=48,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJvgwOEBtOr4FGuJlIklIQKm3OfkIWvUQ6WKkH4golnOeSUymISs3o5y6hYH5HWI7K/ncLUl2tHiOWsgctdLeIUoeTTW/nwl17cN4Q2Pb9DfJ810Po5JwulHYRhesVjyw==',key_name='tempest-keypair-1540796342',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:15:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-h261k56e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "address": "fa:16:3e:b0:d6:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap797d4c83-6f", "ovs_interfaceid": "797d4c83-6f43-4fb4-ac4f-988e3a0cab32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG os_vif [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap797d4c83-6f, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf253359-360f-4047-ba66-3992b1c81e21) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:17:50 user nova-compute[75095]: INFO os_vif [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:d6:b1,bridge_name='br-int',has_traffic_filtering=True,id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap797d4c83-6f')
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Deleting instance files /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b_del
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Deletion of /opt/stack/data/nova/instances/f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b_del complete
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e40732cc-a9f8-4c50-9f91-441442a9b170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.compute.manager [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 16:17:50 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Took 0.77 seconds to deallocate network for instance.
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-83793c45-6b80-48db-b5c3-c850fcd1ca24 req-d3e43d6a-4cc6-4cc9-9af8-c48e58801cfe service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-deleted-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:50 user nova-compute[75095]: INFO nova.compute.manager [req-83793c45-6b80-48db-b5c3-c850fcd1ca24 req-d3e43d6a-4cc6-4cc9-9af8-c48e58801cfe service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Neutron deleted interface 797d4c83-6f43-4fb4-ac4f-988e3a0cab32; detaching it from the instance and deleting it from the info cache
Nov 15 16:17:50 user nova-compute[75095]: DEBUG nova.network.neutron [req-83793c45-6b80-48db-b5c3-c850fcd1ca24 req-d3e43d6a-4cc6-4cc9-9af8-c48e58801cfe service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-83793c45-6b80-48db-b5c3-c850fcd1ca24 req-d3e43d6a-4cc6-4cc9-9af8-c48e58801cfe service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Detach interface failed, port_id=797d4c83-6f43-4fb4-ac4f-988e3a0cab32, reason: Instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:51 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Deleted allocations for instance f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-89e461d2-03d0-4dcb-9e69-b668d11ae6bd tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.091s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] Acquiring lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] Lock "f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:17:51 user nova-compute[75095]: DEBUG nova.compute.manager [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] No waiting events found dispatching network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:17:51 user nova-compute[75095]: WARNING nova.compute.manager [req-9ad87f79-91d3-4ada-a899-97ad6857b09a req-90ee6588-7d8a-4237-9479-2e033c121ede service nova] [instance: f0fd1bbf-9d6a-4dbc-b9d6-f581253ca61b] Received unexpected event network-vif-plugged-797d4c83-6f43-4fb4-ac4f-988e3a0cab32 for instance with vm_state deleted and task_state None.
Nov 15 16:17:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:17:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Verify base images {{(pid=75095) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Image id 42c1c869-d893-4140-8d14-8f5bfccef902 yields fingerprint df5195a66618240fb35ce708d6cdd0a678133003 {{(pid=75095) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] image 42c1c869-d893-4140-8d14-8f5bfccef902 at (/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003): checking
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] image 42c1c869-d893-4140-8d14-8f5bfccef902 at (/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003): image is in use {{(pid=75095) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75095) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] e40732cc-a9f8-4c50-9f91-441442a9b170 is a valid instance name {{(pid=75095) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] e40732cc-a9f8-4c50-9f91-441442a9b170 has a disk file {{(pid=75095) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e40732cc-a9f8-4c50-9f91-441442a9b170 is backed by df5195a66618240fb35ce708d6cdd0a678133003 {{(pid=75095) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b
Nov 15 16:18:02 user nova-compute[75095]: WARNING nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Unknown base file: /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Active base files: /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Removable base files: /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937 /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8 /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6 /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f11c94c332425c9da07ff60ef3809ccd84b077b
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/13d8667b26c72a70d1629bb00b2ecbabf6e50e6b
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5ee7bd22d1e424eb440cfa10274d2d095fcd242c
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8f6df270b94d72ea5b1b373caf2ab4cfcdde1937
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/325cfc98f7916aca24ec8b7f43d7bca7f2d55fb8
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e4d40dceec02886c99df7994bd4f385a540a92f6
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2490d978eca157bd3393547effd7c19ec4974b3c
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/faa73d47f732f09f96da93069e1181c6ac6df35b
Nov 15 16:18:02 user nova-compute[75095]: INFO nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/41baedd14f789787c1feb57cd6b1a561d44e5381
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Verification complete {{(pid=75095) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Verify swap images {{(pid=75095) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 16:18:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.imagecache [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Verify ephemeral images {{(pid=75095) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 16:18:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:18:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:18:37 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:18:38 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:18:43 user nova-compute[75095]: INFO nova.compute.claims [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Claim successful on node user
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:18:43 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.policy [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c77613061a8c475087e49aedec4a9bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '228614fdcc87477786a1c9c97b366eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:18:43 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Creating image(s)
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "/opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk 1073741824" returned: 0 in 0.050s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Successfully created port: 9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Cannot resize image /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Ensure instance console log exists: /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Successfully updated port: 9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquired lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-changed-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.compute.manager [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Refreshing instance network info cache due to event network-changed-9215b360-66ee-4e1d-8000-aecf7658d66f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] Acquiring lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Releasing lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Instance network_info: |[{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] Acquired lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Refreshing network info cache for port 9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Start _get_guest_xml network_info=[{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:18:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:18:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-84717821',display_name='tempest-AttachVolumeNegativeTest-server-84717821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-84717821',id=50,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAn0jrqCrypLAIIkFv6w9GbNLYYL2a58/u4QxLU4IEF6bLxAU5VAboYB0M/S2qzxluxT8962SSE+iFGVH8F8egXq1IAHn1jkyBZqeDF52qbxiZPkD/V7YPHMj2/f6NrsA==',key_name='tempest-keypair-1634385094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-kyi4eu8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:18:45 user nova-compute[75095]:   <uuid>8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8</uuid>
Nov 15 16:18:45 user nova-compute[75095]:   <name>instance-00000032</name>
Nov 15 16:18:45 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:18:45 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:18:45 user nova-compute[75095]:   <metadata>
Nov 15 16:18:45 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:18:45 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:name>tempest-AttachVolumeNegativeTest-server-84717821</nova:name>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:18:45</nova:creationTime>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:18:45 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:18:45 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:owner>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:user uuid="c77613061a8c475087e49aedec4a9bd0">tempest-AttachVolumeNegativeTest-677596313-project-member</nova:user>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:project uuid="228614fdcc87477786a1c9c97b366eeb">tempest-AttachVolumeNegativeTest-677596313</nova:project>
Nov 15 16:18:45 user nova-compute[75095]:       </nova:owner>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:18:45 user nova-compute[75095]:       <nova:ports>
Nov 15 16:18:45 user nova-compute[75095]:         <nova:port uuid="9215b360-66ee-4e1d-8000-aecf7658d66f">
Nov 15 16:18:45 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 16:18:45 user nova-compute[75095]:         </nova:port>
Nov 15 16:18:45 user nova-compute[75095]:       </nova:ports>
Nov 15 16:18:45 user nova-compute[75095]:     </nova:instance>
Nov 15 16:18:45 user nova-compute[75095]:   </metadata>
Nov 15 16:18:45 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:18:45 user nova-compute[75095]:     <system>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="serial">8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8</entry>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="uuid">8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8</entry>
Nov 15 16:18:45 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:18:45 user nova-compute[75095]:     </system>
Nov 15 16:18:45 user nova-compute[75095]:   </sysinfo>
Nov 15 16:18:45 user nova-compute[75095]:   <os>
Nov 15 16:18:45 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:18:45 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:18:45 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:18:45 user nova-compute[75095]:   </os>
Nov 15 16:18:45 user nova-compute[75095]:   <features>
Nov 15 16:18:45 user nova-compute[75095]:     <acpi/>
Nov 15 16:18:45 user nova-compute[75095]:     <apic/>
Nov 15 16:18:45 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:18:45 user nova-compute[75095]:   </features>
Nov 15 16:18:45 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:18:45 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:18:45 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:18:45 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:18:45 user nova-compute[75095]:   </clock>
Nov 15 16:18:45 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:18:45 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:18:45 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:18:45 user nova-compute[75095]:   </cpu>
Nov 15 16:18:45 user nova-compute[75095]:   <devices>
Nov 15 16:18:45 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:18:45 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:18:45 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk"/>
Nov 15 16:18:45 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:18:45 user nova-compute[75095]:     </disk>
Nov 15 16:18:45 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:18:45 user nova-compute[75095]:       <mac address="fa:16:3e:2b:0f:b1"/>
Nov 15 16:18:45 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:18:45 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:18:45 user nova-compute[75095]:       <target dev="tap9215b360-66"/>
Nov 15 16:18:45 user nova-compute[75095]:     </interface>
Nov 15 16:18:45 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:18:45 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/console.log" append="off"/>
Nov 15 16:18:45 user nova-compute[75095]:     </serial>
Nov 15 16:18:45 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:18:45 user nova-compute[75095]:     <video>
Nov 15 16:18:45 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:18:45 user nova-compute[75095]:     </video>
Nov 15 16:18:45 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:18:45 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:18:45 user nova-compute[75095]:     </rng>
Nov 15 16:18:45 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:18:45 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:18:45 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:18:45 user nova-compute[75095]:     </memballoon>
Nov 15 16:18:45 user nova-compute[75095]:   </devices>
Nov 15 16:18:45 user nova-compute[75095]: </domain>
Nov 15 16:18:45 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-84717821',display_name='tempest-AttachVolumeNegativeTest-server-84717821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-84717821',id=50,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAn0jrqCrypLAIIkFv6w9GbNLYYL2a58/u4QxLU4IEF6bLxAU5VAboYB0M/S2qzxluxT8962SSE+iFGVH8F8egXq1IAHn1jkyBZqeDF52qbxiZPkD/V7YPHMj2/f6NrsA==',key_name='tempest-keypair-1634385094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-kyi4eu8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:18:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG os_vif [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '963dfd35-11bf-5ef0-9964-d089887178b6', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9215b360-66, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9215b360-66, col_values=(('qos', UUID('15fbf3e6-dd26-412b-96ef-4208053e30ab')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9215b360-66, col_values=(('external_ids', {'iface-id': '9215b360-66ee-4e1d-8000-aecf7658d66f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:0f:b1', 'vm-uuid': '8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:45 user nova-compute[75095]: INFO os_vif [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66')
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:2b:0f:b1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updated VIF entry in instance network info cache for port 9215b360-66ee-4e1d-8000-aecf7658d66f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG nova.network.neutron [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:18:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8c01a01e-e1d8-4b05-84db-59272d95ea89 req-2b7ff442-7709-425d-8210-1c8cc0341f81 service nova] Releasing lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:18:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG nova.compute.manager [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] No waiting events found dispatching network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:18:47 user nova-compute[75095]: WARNING nova.compute.manager [req-f8bb6fee-9cef-40f4-8222-b3d21cb130d6 req-234565a7-6ac1-4510-afbb-86bd7b78fb3b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received unexpected event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f for instance with vm_state building and task_state spawning.
Nov 15 16:18:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:18:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:18:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Instance spawned successfully.
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] No waiting events found dispatching network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:18:49 user nova-compute[75095]: WARNING nova.compute.manager [req-d2706eab-bde7-4248-964b-02fc8a6fc971 req-8e32e03f-8d90-4eac-81e9-ce6fb1860ac7 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received unexpected event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f for instance with vm_state building and task_state spawning.
Nov 15 16:18:49 user nova-compute[75095]: INFO nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 15 16:18:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:49 user nova-compute[75095]: INFO nova.compute.manager [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Took 6.18 seconds to build instance.
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-57a6dbf8-3cb4-4c1c-8bc2-f75ee28e400a tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.283s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:18:50 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:18:50 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=24.369827270507812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e40732cc-a9f8-4c50-9f91-441442a9b170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:18:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:18:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:18:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:18:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:19:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:19:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:19:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:19:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-changed-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:19:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Refreshing instance network info cache due to event network-changed-4bc047bd-cca5-4bb5-a428-543e5a29ad91. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:19:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] Acquiring lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:19:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] Acquired lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:19:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Refreshing network info cache for port 4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:19:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updated VIF entry in instance network info cache for port 4bc047bd-cca5-4bb5-a428-543e5a29ad91. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:19:23 user nova-compute[75095]: DEBUG nova.network.neutron [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:19:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-976c006f-a1a5-404e-bebc-b81ca7aa56aa req-ff816ce4-71b5-4185-9e12-50d651597558 service nova] Releasing lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:24 user nova-compute[75095]: INFO nova.compute.manager [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attaching volume ea796bf5-7577-4915-8547-0e10cc51a9a5 to /dev/vdb
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.utils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2331857d-2376-4d7c-85e5-74ed8b22eff8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de11cb1-f51f-4781-b29b-988e4328cb84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[816fe548-ad8b-4cd2-a2eb-a88b57f7ebd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a635913-4fd3-45ef-86be-a53a551629ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:19:24 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:19:24 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12771627-9280-40ec-8141-28cc9bd041fe]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG os_brick.utils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:19:24 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating existing volume attachment record: 201e4eba-9406-428f-a124-56fb54369e61 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:19:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mehIUvVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:19:29 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:19:29 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:19:29 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1dd3fd-d868-49a4-9efb-38ea44e49b90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:19:29 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c174318-bff9-4aac-87e3-95aab3ff316d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5] added
Nov 15 16:19:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78babb7c-9a9f-45dc-a551-8400a2cb71b1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd9e55b-0466-4b0a-82fd-4fd2b8eb227f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mehIUvVS {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mehIUvVS" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[818235c5-cdff-40e5-a7c0-34333bae13ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mehIUvVS'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[985781ea-b49e-474e-bb36-4588928375bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ebccfb-0ebd-49d4-87ae-89c4b45e1099]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:19:29 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:19:29 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:19:29 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:19:29 user nova-compute[75095]: 
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ea7bed-0cd0-48b8-8244-00bddc2b0578]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260]
Nov 15 16:19:29 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260] successful.
Nov 15 16:19:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8324a95-e6bb-4af2-97be-96a92345719c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[31915f0d-a2b2-434c-a3e8-2ea1de00de90]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:29 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d4127c-d055-4152-b309-5a8487bef32b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:29 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mehIUvVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23439323765303636', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439323765303636', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:19:30 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:19:30 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:19:30 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:19:30 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:19:30 user nova-compute[75095]:   <serial>ea796bf5-7577-4915-8547-0e10cc51a9a5</serial>
Nov 15 16:19:30 user nova-compute[75095]: </disk>
Nov 15 16:19:30 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:19:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:19:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:19:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No VIF found with MAC fa:16:3e:ca:9a:a7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:19:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c4e4f797-3b92-401e-b126-8f7f291c7d46 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.754s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:33 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:19:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:34 user nova-compute[75095]: INFO nova.compute.manager [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attaching volume 775bb288-76b0-493c-9b2e-94279ee13b4b to /dev/vdc
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.utils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddfa847-1acc-44d8-b021-e458649a6d39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6aac31-29a5-461f-a4a2-a00f569c17db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486a14b-35a7-4ad8-8cd0-3569de1d11de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f6344a-352b-43eb-9eae-d908e966c37e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:19:34 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:19:34 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a7d215-f5bb-4989-a2d5-aef812163c64]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG os_brick.utils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating existing volume attachment record: 53734692-e22e-4726-a65f-e0c54ca800ed {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:19:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReAXUfhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:19:38 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:19:38 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:19:38 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0989c31-3be1-49e7-8b4e-25708796574a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:19:38 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec1d0d6-cc8b-49dc-8ceb-daccb9f83f12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b] added
Nov 15 16:19:38 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[333622f4-c947-4fdc-9d44-b2c5f8d56bfa]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcec3e4-d3e0-4d69-881e-7445da497a72]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReAXUfhj {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ReAXUfhj" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a56dcdb6-11bc-4f28-a364-e9be8c823f8f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ReAXUfhj'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[550bd4b3-c736-43e4-beaf-5a399ba40b2e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:38 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e69a6ea-3d73-456d-b193-3a39360195bd]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef315008-6ac6-4245-bdf5-1d44b6caf559]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260]
Nov 15 16:19:39 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260] successful.
Nov 15 16:19:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1138611-50a6-40bc-9ee4-7946350bbe0f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbbe7ab-20a7-4713-9862-1df0c5bc92ae]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:39 user nova-compute[75095]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:19:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:19:39 user nova-compute[75095]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:19:39 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ead32-7cdd-4ea0-ad0b-088c50dc3ddd]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:19:39 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReAXUfhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23133636633366135', 'path': '/dev/sdc'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133636633366135', 'path': '/dev/sdc'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.objects.instance [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:19:40 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:19:40 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:19:40 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 16:19:40 user nova-compute[75095]:   <serial>775bb288-76b0-493c-9b2e-94279ee13b4b</serial>
Nov 15 16:19:40 user nova-compute[75095]: </disk>
Nov 15 16:19:40 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [{"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-e40732cc-a9f8-4c50-9f91-441442a9b170" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] No VIF found with MAC fa:16:3e:ca:9a:a7, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-d24dbab6-6271-4ef3-91a5-635f32b426a7 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.656s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.202s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:40 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:42 user nova-compute[75095]: INFO nova.compute.manager [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Detaching volume ea796bf5-7577-4915-8547-0e10cc51a9a5
Nov 15 16:19:42 user nova-compute[75095]: INFO nova.virt.block_device [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attempting to driver detach volume ea796bf5-7577-4915-8547-0e10cc51a9a5 from mountpoint /dev/vdb
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Attempting to detach device vdb from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:19:42 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:19:42 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:19:42 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:19:42 user nova-compute[75095]:   <serial>ea796bf5-7577-4915-8547-0e10cc51a9a5</serial>
Nov 15 16:19:42 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:19:42 user nova-compute[75095]: </disk>
Nov 15 16:19:42 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:19:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdb from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the persistent domain config.
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:19:42 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:19:42 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:19:42 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:19:42 user nova-compute[75095]:   <serial>ea796bf5-7577-4915-8547-0e10cc51a9a5</serial>
Nov 15 16:19:42 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:19:42 user nova-compute[75095]: </disk>
Nov 15 16:19:42 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:19:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:19:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:45 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:48 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:19:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:19:49 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:19:49 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8872MB free_disk=24.340530395507812GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:19:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance e40732cc-a9f8-4c50-9f91-441442a9b170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:19:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:19:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:19:55 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:20:00 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:02 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e40732cc-a9f8-4c50-9f91-441442a9b170 is timed out.
Nov 15 16:20:02 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdb from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the live domain config.
Nov 15 16:20:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mehIUvVS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:20:02 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9626b8-8a8a-4d60-8b28-c5c45f388c8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:20:02 user nova-compute[75095]: No targets found.
Nov 15 16:20:02 user nova-compute[75095]: iSNS:
Nov 15 16:20:02 user nova-compute[75095]: No targets found.
Nov 15 16:20:02 user nova-compute[75095]: STATIC:
Nov 15 16:20:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5
Nov 15 16:20:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:20:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:20:02 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b
Nov 15 16:20:02 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:20:02 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:20:02 user nova-compute[75095]: FIRMWARE:
Nov 15 16:20:02 user nova-compute[75095]: No targets found.
Nov 15 16:20:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:20:02 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:20:02 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[15012517-62d2-4166-9a2e-a5fab9ec017c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4346e-20fd-424d-aad3-1618e3b4b85e]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:20:02 user nova-compute[75095]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:20:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 (non-flash)
Nov 15 16:20:02 user nova-compute[75095]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:20:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f595c620b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[508dc0ba-cb9c-4b4e-baa1-03b29c3a2907]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4319d-37b6-4ca0-8954-a2485445f4df]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[153104d8-9677-46b1-bc16-9a5fef917457]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5de9d-83b3-4203-ad00-8db24af8ad92]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66bce5-43c6-44af-bfe4-763b53647527]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fbeca1-6db6-48eb-8b73-6a058ba0b535]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260]
Nov 15 16:20:02 user nova-compute[75095]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5, portal: 172.16.0.220,3260] successful.
Nov 15 16:20:02 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea796bf5-7577-4915-8547-0e10cc51a9a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2d256c-7cb5-41b5-a533-9d07137f2854]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== disconnect_volume: return (290ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:20:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:20:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:20:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c7a3e501-0b35-44d9-908e-a9b5988c9b60 tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.624s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:04 user nova-compute[75095]: INFO nova.compute.manager [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Detaching volume 775bb288-76b0-493c-9b2e-94279ee13b4b
Nov 15 16:20:04 user nova-compute[75095]: INFO nova.virt.block_device [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Attempting to driver detach volume 775bb288-76b0-493c-9b2e-94279ee13b4b from mountpoint /dev/vdc
Nov 15 16:20:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Attempting to detach device vdc from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:20:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:20:04 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:20:04 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:20:04 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 16:20:04 user nova-compute[75095]:   <serial>775bb288-76b0-493c-9b2e-94279ee13b4b</serial>
Nov 15 16:20:04 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 16:20:04 user nova-compute[75095]: </disk>
Nov 15 16:20:04 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:20:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdc from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the persistent domain config.
Nov 15 16:20:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:20:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:20:04 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:20:04 user nova-compute[75095]:   <source dev="/dev/sdc"/>
Nov 15 16:20:04 user nova-compute[75095]:   <target dev="vdc" bus="virtio"/>
Nov 15 16:20:04 user nova-compute[75095]:   <serial>775bb288-76b0-493c-9b2e-94279ee13b4b</serial>
Nov 15 16:20:04 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 16:20:04 user nova-compute[75095]: </disk>
Nov 15 16:20:04 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:20:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:20:05 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:10 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:20:25 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e40732cc-a9f8-4c50-9f91-441442a9b170 is timed out.
Nov 15 16:20:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully detached device vdc from instance e40732cc-a9f8-4c50-9f91-441442a9b170 from the live domain config.
Nov 15 16:20:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ReAXUfhj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:20:25 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[38661c16-e725-4a3d-81b1-5de4b04e287e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:20:25 user nova-compute[75095]: No targets found.
Nov 15 16:20:25 user nova-compute[75095]: iSNS:
Nov 15 16:20:25 user nova-compute[75095]: No targets found.
Nov 15 16:20:25 user nova-compute[75095]: STATIC:
Nov 15 16:20:25 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b
Nov 15 16:20:25 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:20:25 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:20:25 user nova-compute[75095]: FIRMWARE:
Nov 15 16:20:25 user nova-compute[75095]: No targets found.
Nov 15 16:20:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:20:25 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:20:25 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1482307-0a40-4557-b8c0-dff6de396ef7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[da76d442-90f1-4ac0-9409-f38593022684]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:20:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b (non-flash)
Nov 15 16:20:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c1b3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b'): ({'sdc'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Removing single pathed devices sdc {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d45657-d2ad-41f9-9e25-b3a74ea23e96]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2ff769-58f5-4e24-bc2a-7361f1bfc066]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Flushing IO for device /dev/sdc {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dd5219-0b08-43c4-a060-60df99951d4c]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[134a2323-d3ec-4d72-932a-b764f401c0a7]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] SCSI volumes sdc have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3724659d-c922-4ef7-bb13-0718ed5ea6b0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f0dcc-1a22-420f-9150-7d0c55627dab]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260]
Nov 15 16:20:25 user nova-compute[75095]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b, portal: 172.16.0.220,3260] successful.
Nov 15 16:20:25 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:775bb288-76b0-493c-9b2e-94279ee13b4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4728627a-034b-4c41-a0c8-9f35451e2dca]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] <== disconnect_volume: return (288ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:20:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:26 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'flavor' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:20:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8f8dc05d-c37a-4441-987a-4b063636645b tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:27 user nova-compute[75095]: INFO nova.compute.manager [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Terminating instance
Nov 15 16:20:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-unplugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] No waiting events found dispatching network-vif-unplugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:20:27 user nova-compute[75095]: DEBUG nova.compute.manager [req-9798b5fa-d838-49b6-b988-d393b05bfc4f req-84ac063a-4fda-43ac-bb63-3e52b69ae35c service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-unplugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Instance destroyed successfully.
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lazy-loading 'resources' on Instance uuid e40732cc-a9f8-4c50-9f91-441442a9b170 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:17:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1264554240',display_name='tempest-AttachVolumeTestJSON-server-1264554240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1264554240',id=49,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMULM/Zj7KAxy8PvrIoHDRqYY8C+ft4hGAx36pZkn3eF05RMCRZfytk0pGws4nAyFJMHbIIWL6iSIG5maOD4c0tzbocRQa72UMb23JhdcE5pXz/eC22Q0vh9Bz9H5One0Q==',key_name='tempest-keypair-107407332',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56b8acac89af43a2a6c63b27f6d56528',ramdisk_id='',reservation_id='r-olkz2l9y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-640760510',owner_user_name='tempest-AttachVolumeTestJSON-640760510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:17:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='affac16301c14d9bb758222765b5f600',uuid=e40732cc-a9f8-4c50-9f91-441442a9b170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converting VIF {"id": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "address": "fa:16:3e:ca:9a:a7", "network": {"id": "e65a4d24-ce59-4b4f-be86-8183fb0879b8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-975868064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56b8acac89af43a2a6c63b27f6d56528", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4bc047bd-cc", "ovs_interfaceid": "4bc047bd-cca5-4bb5-a428-543e5a29ad91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG os_vif [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4bc047bd-cc, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=98bddff8-c9d6-448d-a257-d292946e5a3e) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:20:28 user nova-compute[75095]: INFO os_vif [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:9a:a7,bridge_name='br-int',has_traffic_filtering=True,id=4bc047bd-cca5-4bb5-a428-543e5a29ad91,network=Network(e65a4d24-ce59-4b4f-be86-8183fb0879b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4bc047bd-cc')
Nov 15 16:20:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Deleting instance files /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170_del
Nov 15 16:20:28 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Deletion of /opt/stack/data/nova/instances/e40732cc-a9f8-4c50-9f91-441442a9b170_del complete
Nov 15 16:20:28 user nova-compute[75095]: INFO nova.compute.manager [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 16:20:28 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:20:28 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:20:29 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Took 0.84 seconds to deallocate network for instance.
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-8b47cf42-b573-4677-a2f5-471cf2d1a6d5 req-2af71769-4867-4c86-847d-3502ae09f4aa service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-deleted-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:29 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Deleted allocations for instance e40732cc-a9f8-4c50-9f91-441442a9b170
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e98f625f-4886-426d-a99b-563f3d0d54dc tempest-AttachVolumeTestJSON-640760510 tempest-AttachVolumeTestJSON-640760510-project-member] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.124s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] Acquiring lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] Lock "e40732cc-a9f8-4c50-9f91-441442a9b170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:29 user nova-compute[75095]: DEBUG nova.compute.manager [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] No waiting events found dispatching network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:20:29 user nova-compute[75095]: WARNING nova.compute.manager [req-69ebd735-1224-4cd0-ad07-955d7a9466a3 req-651bb1d6-247d-4731-8693-9a06789e21ef service nova] [instance: e40732cc-a9f8-4c50-9f91-441442a9b170] Received unexpected event network-vif-plugged-4bc047bd-cca5-4bb5-a428-543e5a29ad91 for instance with vm_state deleted and task_state None.
Nov 15 16:20:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-changed-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Refreshing instance network info cache due to event network-changed-9215b360-66ee-4e1d-8000-aecf7658d66f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] Acquiring lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] Acquired lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Refreshing network info cache for port 9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updated VIF entry in instance network info cache for port 9215b360-66ee-4e1d-8000-aecf7658d66f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG nova.network.neutron [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:20:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3cd50bfe-ae55-4c32-81e8-150bd25dc24e req-eaaba4ca-4eb5-4b76-a896-441657e89cf9 service nova] Releasing lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:35 user nova-compute[75095]: INFO nova.compute.manager [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Attaching volume cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 to /dev/vdb
Nov 15 16:20:35 user nova-compute[75095]: DEBUG os_brick.utils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a94d19-dd93-46d2-94a9-c16b799a587e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:35 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14271c4-21e8-4f2f-aca9-a5ab960e1f89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4786fe26-3cd6-45bc-b479-b0374358a841]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[401a942f-2ed0-430e-a570-2426a3e17cad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:20:36 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:20:36 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc61868-b096-4f50-aa37-11ab6378cd22]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG os_brick.utils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:20:36 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating existing volume attachment record: e8fe99b5-2fe3-46bf-ba7c-f46f4e66f91b {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:20:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFQhTcNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:20:40 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:20:40 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:20:40 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7025e0-097b-409f-ad4d-e5732970097e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:20:40 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a13e0-e4d6-4bce-9c53-05d8c3685191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147] added
Nov 15 16:20:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.194s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd86f095-d8d3-45b1-93b6-509ce4c153e8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787cacf-fb20-4799-bbfe-1855d3f6a208]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFQhTcNd {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFQhTcNd" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40f73c-1316-404a-b522-607e230be876]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFQhTcNd'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d2aaa2-67be-4d21-8d44-df071a937768]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[423d2ae2-790e-41d0-b014-2f07320529a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:20:40 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:20:40 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:20:40 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:20:40 user nova-compute[75095]: 
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1dce7-86f7-4cf5-8e47-f1e1b47cd67e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260]
Nov 15 16:20:40 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260] successful.
Nov 15 16:20:40 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24d8d55-7d82-487c-a027-e2ff787b5135]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:20:40 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc37f1f-e4b4-4980-9c1d-ebc073342807]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)
Nov 15 16:20:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)
Nov 15 16:20:41 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20c95fa-9c23-485a-b19c-d95ceabc5e7b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFQhTcNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:20:41 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.476s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== connect_volume: return (1479ms) {'type': 'block', 'scsi_wwn': '23839393365666531', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839393365666531', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:20:42 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:20:42 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:20:42 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:20:42 user nova-compute[75095]:   <serial>cdb0274b-d2a7-4a0f-8ae4-75b6bc393147</serial>
Nov 15 16:20:42 user nova-compute[75095]: </disk>
Nov 15 16:20:42 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [{"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] No VIF found with MAC fa:16:3e:2b:0f:b1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8b223807-5ebd-4325-b7a1-cb7420972181 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.728s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:43 user nova-compute[75095]: INFO nova.compute.manager [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Detaching volume cdb0274b-d2a7-4a0f-8ae4-75b6bc393147
Nov 15 16:20:43 user nova-compute[75095]: INFO nova.virt.block_device [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Attempting to driver detach volume cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 from mountpoint /dev/vdb
Nov 15 16:20:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Attempting to detach device vdb from instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:20:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:20:43 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:20:43 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:20:43 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:20:43 user nova-compute[75095]:   <serial>cdb0274b-d2a7-4a0f-8ae4-75b6bc393147</serial>
Nov 15 16:20:43 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:20:43 user nova-compute[75095]: </disk>
Nov 15 16:20:43 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:20:43 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 from the persistent domain config.
Nov 15 16:20:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:20:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:20:43 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:20:43 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:20:43 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:20:43 user nova-compute[75095]:   <serial>cdb0274b-d2a7-4a0f-8ae4-75b6bc393147</serial>
Nov 15 16:20:43 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:20:43 user nova-compute[75095]: </disk>
Nov 15 16:20:43 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:20:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:20:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:20:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:50 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:20:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:20:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.36691665649414GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:20:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:20:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:20:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:20:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:04 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 is timed out.
Nov 15 16:21:04 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully detached device vdb from instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 from the live domain config.
Nov 15 16:21:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFQhTcNd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:21:04 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dc5898-380e-453b-a22d-7c28c69ed130]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:21:04 user nova-compute[75095]: No targets found.
Nov 15 16:21:04 user nova-compute[75095]: iSNS:
Nov 15 16:21:04 user nova-compute[75095]: No targets found.
Nov 15 16:21:04 user nova-compute[75095]: STATIC:
Nov 15 16:21:04 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147
Nov 15 16:21:04 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:21:04 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:21:04 user nova-compute[75095]: FIRMWARE:
Nov 15 16:21:04 user nova-compute[75095]: No targets found.
Nov 15 16:21:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:21:04 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:21:04 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa74423-8376-44e7-bb28-1675a1dcc3d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade0e47-ceb0-45d5-9c1f-314cb00e2b3f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)
Nov 15 16:21:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 (non-flash)
Nov 15 16:21:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c3e6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0461a182-3ce3-4d3e-af90-9f80744f082e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[40faedc0-1575-44bf-a181-b64a677ea8b4]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[58af5850-9706-4031-b3e1-cf0524aa6b2d]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0282e5-98e3-4870-81f4-4e0e15f0aeb9]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[595113cd-2e39-4893-a946-2743818f9949]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67df71f7-123e-4b13-91ce-e112141ed6e0]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260]
Nov 15 16:21:04 user nova-compute[75095]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147, portal: 172.16.0.220,3260] successful.
Nov 15 16:21:04 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdb0274b-d2a7-4a0f-8ae4-75b6bc393147 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0e4d07-6f26-42aa-accd-a163d6393452]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] <== disconnect_volume: return (313ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:21:04 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:21:05 user nova-compute[75095]: DEBUG nova.objects.instance [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'flavor' on Instance uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:21:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-24ec0db1-5326-4097-a434-49f58291cb29 tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.596s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:34 user nova-compute[75095]: INFO nova.compute.manager [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Terminating instance
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.compute.manager [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-unplugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] No waiting events found dispatching network-vif-unplugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-916c4f10-9542-465f-941a-a2e7526276ef req-ff9ec794-e86a-4ca4-80cf-62508aa73cda service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-unplugged-9215b360-66ee-4e1d-8000-aecf7658d66f for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Instance destroyed successfully.
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.objects.instance [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lazy-loading 'resources' on Instance uuid 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:18:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-84717821',display_name='tempest-AttachVolumeNegativeTest-server-84717821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-84717821',id=50,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAn0jrqCrypLAIIkFv6w9GbNLYYL2a58/u4QxLU4IEF6bLxAU5VAboYB0M/S2qzxluxT8962SSE+iFGVH8F8egXq1IAHn1jkyBZqeDF52qbxiZPkD/V7YPHMj2/f6NrsA==',key_name='tempest-keypair-1634385094',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:18:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='228614fdcc87477786a1c9c97b366eeb',ramdisk_id='',reservation_id='r-kyi4eu8a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-677596313',owner_user_name='tempest-AttachVolumeNegativeTest-677596313-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:18:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c77613061a8c475087e49aedec4a9bd0',uuid=8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converting VIF {"id": "9215b360-66ee-4e1d-8000-aecf7658d66f", "address": "fa:16:3e:2b:0f:b1", "network": {"id": "5b7f8c2c-6e82-43f5-b654-bce8e6dddf07", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-280451024-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "228614fdcc87477786a1c9c97b366eeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9215b360-66", "ovs_interfaceid": "9215b360-66ee-4e1d-8000-aecf7658d66f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG os_vif [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9215b360-66, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15fbf3e6-dd26-412b-96ef-4208053e30ab) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:34 user nova-compute[75095]: INFO os_vif [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:0f:b1,bridge_name='br-int',has_traffic_filtering=True,id=9215b360-66ee-4e1d-8000-aecf7658d66f,network=Network(5b7f8c2c-6e82-43f5-b654-bce8e6dddf07),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9215b360-66')
Nov 15 16:21:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Deleting instance files /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8_del
Nov 15 16:21:34 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Deletion of /opt/stack/data/nova/instances/8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8_del complete
Nov 15 16:21:34 user nova-compute[75095]: INFO nova.compute.manager [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 16:21:34 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:21:34 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:21:35 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Took 0.65 seconds to deallocate network for instance.
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d1facb16-a6f6-4a7f-9010-d3c4fe107a61 req-f186eb4f-b982-4911-ba3c-43b4dc11205b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-deleted-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:21:35 user nova-compute[75095]: INFO nova.compute.manager [req-d1facb16-a6f6-4a7f-9010-d3c4fe107a61 req-f186eb4f-b982-4911-ba3c-43b4dc11205b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Neutron deleted interface 9215b360-66ee-4e1d-8000-aecf7658d66f; detaching it from the instance and deleting it from the info cache
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.network.neutron [req-d1facb16-a6f6-4a7f-9010-d3c4fe107a61 req-f186eb4f-b982-4911-ba3c-43b4dc11205b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.compute.manager [req-d1facb16-a6f6-4a7f-9010-d3c4fe107a61 req-f186eb4f-b982-4911-ba3c-43b4dc11205b service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Detach interface failed, port_id=9215b360-66ee-4e1d-8000-aecf7658d66f, reason: Instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:21:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:35 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Deleted allocations for instance 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8
Nov 15 16:21:35 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-a2008a24-8590-49fb-8944-420f6fa7d97f tempest-AttachVolumeNegativeTest-677596313 tempest-AttachVolumeNegativeTest-677596313-project-member] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:21:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] Acquiring lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:36 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] Lock "8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:36 user nova-compute[75095]: DEBUG nova.compute.manager [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] No waiting events found dispatching network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:21:36 user nova-compute[75095]: WARNING nova.compute.manager [req-05f65d22-48e4-455b-8cd1-3b72b154c1c8 req-a8a843ac-23c5-4fb9-9311-2186ec9e3972 service nova] [instance: 8f7480c2-f2a1-48ce-ab44-8b73d6ba83d8] Received unexpected event network-vif-plugged-9215b360-66ee-4e1d-8000-aecf7658d66f for instance with vm_state deleted and task_state None.
Nov 15 16:21:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:21:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:21:42 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:21:42 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:43 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:21:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:21:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:50 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:21:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:21:51 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9120MB free_disk=24.38495635986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:21:51 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:21:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:21:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:22:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:22:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:22:52 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:22:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:22:53 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9185MB free_disk=24.37303924560547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:22:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.105s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:22:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:22:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:22:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:23:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:20 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:25 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:23:26 user nova-compute[75095]: INFO nova.compute.claims [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Claim successful on node user
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:23:26 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:23:27 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:23:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG nova.policy [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6d971d0a498943b884b75e9bace10496', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b119ab2fe7fe480b82f4c0113d14afea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:23:27 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Creating image(s)
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "/opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "/opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.167s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk 1073741824" returned: 0 in 0.056s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:27 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Successfully created port: 7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Cannot resize image /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Ensure instance console log exists: /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Successfully updated port: 7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquired lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-changed-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.compute.manager [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Refreshing instance network info cache due to event network-changed-7a21f062-2afc-4a89-98cd-1ea518dac92f. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] Acquiring lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.neutron [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Releasing lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Instance network_info: |[{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] Acquired lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.neutron [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Refreshing network info cache for port 7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Start _get_guest_xml network_info=[{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:23:28 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:23:28 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-188716719',display_name='tempest-VolumesActionsTest-instance-188716719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-188716719',id=51,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b119ab2fe7fe480b82f4c0113d14afea',ramdisk_id='',reservation_id='r-lgr7cfh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2127011977',owner_user_name='tempest-VolumesActionsTest-2127011977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:23:27Z,user_data=None,user_id='6d971d0a498943b884b75e9bace10496',uuid=ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converting VIF {"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lazy-loading 'pci_devices' on Instance uuid ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:23:28 user nova-compute[75095]:   <uuid>ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5</uuid>
Nov 15 16:23:28 user nova-compute[75095]:   <name>instance-00000033</name>
Nov 15 16:23:28 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:23:28 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:23:28 user nova-compute[75095]:   <metadata>
Nov 15 16:23:28 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:23:28 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:name>tempest-VolumesActionsTest-instance-188716719</nova:name>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:23:28</nova:creationTime>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:23:28 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:23:28 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:owner>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:user uuid="6d971d0a498943b884b75e9bace10496">tempest-VolumesActionsTest-2127011977-project-member</nova:user>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:project uuid="b119ab2fe7fe480b82f4c0113d14afea">tempest-VolumesActionsTest-2127011977</nova:project>
Nov 15 16:23:28 user nova-compute[75095]:       </nova:owner>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:23:28 user nova-compute[75095]:       <nova:ports>
Nov 15 16:23:28 user nova-compute[75095]:         <nova:port uuid="7a21f062-2afc-4a89-98cd-1ea518dac92f">
Nov 15 16:23:28 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 16:23:28 user nova-compute[75095]:         </nova:port>
Nov 15 16:23:28 user nova-compute[75095]:       </nova:ports>
Nov 15 16:23:28 user nova-compute[75095]:     </nova:instance>
Nov 15 16:23:28 user nova-compute[75095]:   </metadata>
Nov 15 16:23:28 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:23:28 user nova-compute[75095]:     <system>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="serial">ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5</entry>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="uuid">ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5</entry>
Nov 15 16:23:28 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:23:28 user nova-compute[75095]:     </system>
Nov 15 16:23:28 user nova-compute[75095]:   </sysinfo>
Nov 15 16:23:28 user nova-compute[75095]:   <os>
Nov 15 16:23:28 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:23:28 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:23:28 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:23:28 user nova-compute[75095]:   </os>
Nov 15 16:23:28 user nova-compute[75095]:   <features>
Nov 15 16:23:28 user nova-compute[75095]:     <acpi/>
Nov 15 16:23:28 user nova-compute[75095]:     <apic/>
Nov 15 16:23:28 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:23:28 user nova-compute[75095]:   </features>
Nov 15 16:23:28 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:23:28 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:23:28 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:23:28 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:23:28 user nova-compute[75095]:   </clock>
Nov 15 16:23:28 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:23:28 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:23:28 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:23:28 user nova-compute[75095]:   </cpu>
Nov 15 16:23:28 user nova-compute[75095]:   <devices>
Nov 15 16:23:28 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:23:28 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:23:28 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk"/>
Nov 15 16:23:28 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:23:28 user nova-compute[75095]:     </disk>
Nov 15 16:23:28 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:23:28 user nova-compute[75095]:       <mac address="fa:16:3e:68:95:ac"/>
Nov 15 16:23:28 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:23:28 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:23:28 user nova-compute[75095]:       <target dev="tap7a21f062-2a"/>
Nov 15 16:23:28 user nova-compute[75095]:     </interface>
Nov 15 16:23:28 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:23:28 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/console.log" append="off"/>
Nov 15 16:23:28 user nova-compute[75095]:     </serial>
Nov 15 16:23:28 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:23:28 user nova-compute[75095]:     <video>
Nov 15 16:23:28 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:23:28 user nova-compute[75095]:     </video>
Nov 15 16:23:28 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:23:28 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:23:28 user nova-compute[75095]:     </rng>
Nov 15 16:23:28 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:23:28 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:23:28 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:23:28 user nova-compute[75095]:     </memballoon>
Nov 15 16:23:28 user nova-compute[75095]:   </devices>
Nov 15 16:23:28 user nova-compute[75095]: </domain>
Nov 15 16:23:28 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-188716719',display_name='tempest-VolumesActionsTest-instance-188716719',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-188716719',id=51,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b119ab2fe7fe480b82f4c0113d14afea',ramdisk_id='',reservation_id='r-lgr7cfh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2127011977',owner_user_name='tempest-VolumesActionsTest-2127011977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:23:27Z,user_data=None,user_id='6d971d0a498943b884b75e9bace10496',uuid=ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converting VIF {"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG os_vif [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2536c715-4ee8-570b-b652-8828eadf3080', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a21f062-2a, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a21f062-2a, col_values=(('qos', UUID('3ad22740-c148-44a5-a41c-c4fef52a4e1d')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a21f062-2a, col_values=(('external_ids', {'iface-id': '7a21f062-2afc-4a89-98cd-1ea518dac92f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:95:ac', 'vm-uuid': 'ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:28 user nova-compute[75095]: INFO os_vif [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a')
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:23:28 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] No VIF found with MAC fa:16:3e:68:95:ac, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:23:29 user nova-compute[75095]: DEBUG nova.network.neutron [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updated VIF entry in instance network info cache for port 7a21f062-2afc-4a89-98cd-1ea518dac92f. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:23:29 user nova-compute[75095]: DEBUG nova.network.neutron [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:23:29 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-72a1a1e5-7667-4996-ab34-a9e3b8911aea req-dfb23b7e-f627-490c-af18-d2bcb14a581e service nova] Releasing lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:23:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:23:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] No waiting events found dispatching network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:23:31 user nova-compute[75095]: WARNING nova.compute.manager [req-4c675f80-76df-40e5-a3eb-a3872ec66b65 req-8a8f4533-5bc8-48e0-9910-b4af6d9fddd9 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received unexpected event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f for instance with vm_state building and task_state spawning.
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:23:32 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Instance spawned successfully.
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:23:32 user nova-compute[75095]: INFO nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 15 16:23:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:23:32 user nova-compute[75095]: INFO nova.compute.manager [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Took 5.97 seconds to build instance.
Nov 15 16:23:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e47ac2f1-cbc5-4d04-a518-828cd9fd2bff tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.060s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:23:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] No waiting events found dispatching network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:23:33 user nova-compute[75095]: WARNING nova.compute.manager [req-b8ba6c3f-9a4e-497a-9fe5-9c22836c762f req-19a35fda-869f-42b0-b507-e90cbc18fbc4 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received unexpected event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f for instance with vm_state active and task_state None.
Nov 15 16:23:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:23:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:45 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:23:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:23:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:23:54 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:23:54 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8973MB free_disk=24.342262268066406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:23:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:23:55 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:23:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:23:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:23:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:23:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:05 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:24:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4995-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:24:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:24:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:24:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:24:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:24:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:24:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [{"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:24:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:24:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:24:48 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:24:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:24:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:24:53 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:24:54 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:24:54 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.341514587402344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:24:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:24:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:24:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:25:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:25:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:21 user nova-compute[75095]: INFO nova.compute.manager [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Terminating instance
Nov 15 16:25:21 user nova-compute[75095]: DEBUG nova.compute.manager [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-unplugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] No waiting events found dispatching network-vif-unplugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG nova.compute.manager [req-3808d107-fb53-445d-ae9f-a2eb1591df89 req-d6d062b6-7602-43cb-a303-2a82f42f6b75 service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-unplugged-7a21f062-2afc-4a89-98cd-1ea518dac92f for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Instance destroyed successfully.
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lazy-loading 'resources' on Instance uuid ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:23:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-188716719',display_name='tempest-VolumesActionsTest-instance-188716719',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-188716719',id=51,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b119ab2fe7fe480b82f4c0113d14afea',ramdisk_id='',reservation_id='r-lgr7cfh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2127011977',owner_user_name='tempest-VolumesActionsTest-2127011977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:23:33Z,user_data=None,user_id='6d971d0a498943b884b75e9bace10496',uuid=ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converting VIF {"id": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "address": "fa:16:3e:68:95:ac", "network": {"id": "f2e45554-31c7-46fe-8b67-d6c34612ae78", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1196522660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b119ab2fe7fe480b82f4c0113d14afea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a21f062-2a", "ovs_interfaceid": "7a21f062-2afc-4a89-98cd-1ea518dac92f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG os_vif [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a21f062-2a, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ad22740-c148-44a5-a41c-c4fef52a4e1d) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:22 user nova-compute[75095]: INFO os_vif [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:95:ac,bridge_name='br-int',has_traffic_filtering=True,id=7a21f062-2afc-4a89-98cd-1ea518dac92f,network=Network(f2e45554-31c7-46fe-8b67-d6c34612ae78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a21f062-2a')
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Deleting instance files /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5_del
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Deletion of /opt/stack/data/nova/instances/ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5_del complete
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.compute.manager [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 16:25:22 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Took 0.36 seconds to deallocate network for instance.
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-6076658c-df8c-474a-b4f8-6f87cfff3f61 req-490ad9cd-1b93-4fd1-8c71-b9e64275026c service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-deleted-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.compute.manager [req-6076658c-df8c-474a-b4f8-6f87cfff3f61 req-490ad9cd-1b93-4fd1-8c71-b9e64275026c service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Neutron deleted interface 7a21f062-2afc-4a89-98cd-1ea518dac92f; detaching it from the instance and deleting it from the info cache
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.network.neutron [req-6076658c-df8c-474a-b4f8-6f87cfff3f61 req-490ad9cd-1b93-4fd1-8c71-b9e64275026c service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.compute.manager [req-6076658c-df8c-474a-b4f8-6f87cfff3f61 req-490ad9cd-1b93-4fd1-8c71-b9e64275026c service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Detach interface failed, port_id=7a21f062-2afc-4a89-98cd-1ea518dac92f, reason: Instance ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5 could not be found. {{(pid=75095) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:25:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:22 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Deleted allocations for instance ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5
Nov 15 16:25:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e5a28fd7-3f7c-413e-9d4d-9fa7b36e9eea tempest-VolumesActionsTest-2127011977 tempest-VolumesActionsTest-2127011977-project-member] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.303s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:25:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] Acquiring lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] Lock "ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:23 user nova-compute[75095]: DEBUG nova.compute.manager [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] No waiting events found dispatching network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:25:23 user nova-compute[75095]: WARNING nova.compute.manager [req-6e46e29e-d1ea-4576-b6ed-32eefb82d2c7 req-6a304572-c56d-456b-9d59-79f0c00db27e service nova] [instance: ec0296c5-4e0c-4aed-bb50-c52c9a8ff3e5] Received unexpected event network-vif-plugged-7a21f062-2afc-4a89-98cd-1ea518dac92f for instance with vm_state deleted and task_state None.
Nov 15 16:25:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:25:44 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:25:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:25:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:25:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:25:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:25:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:25:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:55 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:25:56 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:25:56 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9187MB free_disk=24.368587493896484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:25:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:25:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:26:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:26:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:26:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:35 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:45 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:26:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:26:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:26:55 user nova-compute[75095]: INFO nova.compute.claims [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Claim successful on node user
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.178s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:26:55 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:26:55 user nova-compute[75095]: INFO nova.virt.block_device [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Booting with volume 0ba6394f-15cc-40fb-a83c-e02fa64607d1 at /dev/vda
Nov 15 16:26:55 user nova-compute[75095]: DEBUG nova.policy [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00fcfd9786fc4073b00c7bf417ebae5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd115a178396949f3843f91075f0b490a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG os_brick.utils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a93cb-a967-4fd9-a5db-1a18ef5d5ca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a792c4d-a66b-40a5-99d9-a43de1e139c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e5dfe-befc-4137-aaad-403b99ef56ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e6325-9e40-45d0-8e1a-b3440b04203c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:26:55 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:26:56 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:26:56 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97fe0de-1553-41fe-97c8-31ded52a9ea6]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG os_brick.utils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating existing volume attachment record: 579b9ec7-245f-47f4-b899-d859437aaf3f {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:26:56 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Successfully created port: 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Successfully updated port: 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-changed-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.compute.manager [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing instance network info cache due to event network-changed-976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance network_info: |[{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.network.neutron [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:26:57 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:26:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:26:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9180MB free_disk=24.357685089111328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 26fd407f-8689-4efe-b2d4-3cef88739e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated VIF entry in instance network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.network.neutron [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-bb4853b7-40d3-496b-bfe1-d824445a66f9 req-1b0a2dbd-176a-43f7-bc48-1ab813c6ed94 service nova] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:26:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:26:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:27:00 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Creating image(s)
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Ensure instance console log exists: /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start _get_guest_xml network_info=[{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '579b9ec7-245f-47f4-b899-d859437aaf3f', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26fd407f-8689-4efe-b2d4-3cef88739e93', 'attached_at': '', 'detached_at': '', 'volume_id': '0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'serial': '0ba6394f-15cc-40fb-a83c-e02fa64607d1'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:27:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:27:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:27:00 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:27:00 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:27:00 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be263fb-3de4-4eae-9c18-8895020d02b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:27:00 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ffa4b-017e-4163-8764-3ac48985b523]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1] added
Nov 15 16:27:00 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a61e868-60dd-4465-b1f9-8bbe2d031224]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7da167-f155-4fbd-ae85-e6cbfe82cf56]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEVvlOKX {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEVvlOKX" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a71f9-7479-44c3-9012-ac55935d6431]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEVvlOKX'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deb03c4-b8c7-444a-b506-2444099e3488]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2a235-48f1-44b1-96d1-9eae0864592b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:27:00 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:27:00 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:27:00 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:27:00 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:27:00 user nova-compute[75095]: 
Nov 15 16:27:00 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cc7d37-52d7-43c2-9346-8f6be8759a0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]
Nov 15 16:27:01 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.
Nov 15 16:27:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71d6cf4-153c-404e-831c-bc4dbd091289]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9754491d-1993-47f0-8658-c0d30c14d5f1]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:27:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:27:01 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7090ee8-9cfa-4a49-a09a-6dfc5e1d604f]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:27:01 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23566323037333166', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323037333166', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXZb7oKmMmSD5gmHkxV983kUtx5CiOSwQqKPyfIUNup6wvBswtmXawJvL4VYXzsmYM0UIOnyY3HXhK/iTrP6unt5CF2hXBHAM/TkLdzPtSODwOxw8pvlsfXdKLzKOi8Cw==',key_name='tempest-TestShelveInstance-1020023239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:26:56Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'pci_devices' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:27:02 user nova-compute[75095]:   <uuid>26fd407f-8689-4efe-b2d4-3cef88739e93</uuid>
Nov 15 16:27:02 user nova-compute[75095]:   <name>instance-00000034</name>
Nov 15 16:27:02 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:27:02 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:27:02 user nova-compute[75095]:   <metadata>
Nov 15 16:27:02 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:27:02 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:27:02 user nova-compute[75095]:       <nova:name>tempest-TestShelveInstance-server-945819856</nova:name>
Nov 15 16:27:02 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:27:00</nova:creationTime>
Nov 15 16:27:02 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:27:02 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:27:02 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:27:02 user nova-compute[75095]:       <nova:owner>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:user uuid="00fcfd9786fc4073b00c7bf417ebae5a">tempest-TestShelveInstance-2112879318-project-member</nova:user>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:project uuid="d115a178396949f3843f91075f0b490a">tempest-TestShelveInstance-2112879318</nova:project>
Nov 15 16:27:02 user nova-compute[75095]:       </nova:owner>
Nov 15 16:27:02 user nova-compute[75095]:       <nova:ports>
Nov 15 16:27:02 user nova-compute[75095]:         <nova:port uuid="976b27ea-3407-4240-ad29-192a80e3d257">
Nov 15 16:27:02 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 16:27:02 user nova-compute[75095]:         </nova:port>
Nov 15 16:27:02 user nova-compute[75095]:       </nova:ports>
Nov 15 16:27:02 user nova-compute[75095]:     </nova:instance>
Nov 15 16:27:02 user nova-compute[75095]:   </metadata>
Nov 15 16:27:02 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:27:02 user nova-compute[75095]:     <system>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="serial">26fd407f-8689-4efe-b2d4-3cef88739e93</entry>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="uuid">26fd407f-8689-4efe-b2d4-3cef88739e93</entry>
Nov 15 16:27:02 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:27:02 user nova-compute[75095]:     </system>
Nov 15 16:27:02 user nova-compute[75095]:   </sysinfo>
Nov 15 16:27:02 user nova-compute[75095]:   <os>
Nov 15 16:27:02 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:27:02 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:27:02 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:27:02 user nova-compute[75095]:   </os>
Nov 15 16:27:02 user nova-compute[75095]:   <features>
Nov 15 16:27:02 user nova-compute[75095]:     <acpi/>
Nov 15 16:27:02 user nova-compute[75095]:     <apic/>
Nov 15 16:27:02 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:27:02 user nova-compute[75095]:   </features>
Nov 15 16:27:02 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:27:02 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:27:02 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:27:02 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:27:02 user nova-compute[75095]:   </clock>
Nov 15 16:27:02 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:27:02 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:27:02 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:27:02 user nova-compute[75095]:   </cpu>
Nov 15 16:27:02 user nova-compute[75095]:   <devices>
Nov 15 16:27:02 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:27:02 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:27:02 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 16:27:02 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:27:02 user nova-compute[75095]:       <serial>0ba6394f-15cc-40fb-a83c-e02fa64607d1</serial>
Nov 15 16:27:02 user nova-compute[75095]:     </disk>
Nov 15 16:27:02 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:27:02 user nova-compute[75095]:       <mac address="fa:16:3e:6f:27:ae"/>
Nov 15 16:27:02 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:27:02 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:27:02 user nova-compute[75095]:       <target dev="tap976b27ea-34"/>
Nov 15 16:27:02 user nova-compute[75095]:     </interface>
Nov 15 16:27:02 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:27:02 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93/console.log" append="off"/>
Nov 15 16:27:02 user nova-compute[75095]:     </serial>
Nov 15 16:27:02 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:27:02 user nova-compute[75095]:     <video>
Nov 15 16:27:02 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:27:02 user nova-compute[75095]:     </video>
Nov 15 16:27:02 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:27:02 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:27:02 user nova-compute[75095]:     </rng>
Nov 15 16:27:02 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:27:02 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:27:02 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:27:02 user nova-compute[75095]:     </memballoon>
Nov 15 16:27:02 user nova-compute[75095]:   </devices>
Nov 15 16:27:02 user nova-compute[75095]: </domain>
Nov 15 16:27:02 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXZb7oKmMmSD5gmHkxV983kUtx5CiOSwQqKPyfIUNup6wvBswtmXawJvL4VYXzsmYM0UIOnyY3HXhK/iTrP6unt5CF2hXBHAM/TkLdzPtSODwOxw8pvlsfXdKLzKOi8Cw==',key_name='tempest-TestShelveInstance-1020023239',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:26:56Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG os_vif [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd413c392-2c5d-52d6-b18a-2212b71f749a', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap976b27ea-34, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap976b27ea-34, col_values=(('qos', UUID('de125133-f7b1-4797-9cec-0b9d706263d6')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap976b27ea-34, col_values=(('external_ids', {'iface-id': '976b27ea-3407-4240-ad29-192a80e3d257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:27:ae', 'vm-uuid': '26fd407f-8689-4efe-b2d4-3cef88739e93'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:02 user nova-compute[75095]: INFO os_vif [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34')
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:27:02 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] No VIF found with MAC fa:16:3e:6f:27:ae, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:27:03 user nova-compute[75095]: DEBUG nova.compute.manager [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:27:03 user nova-compute[75095]: WARNING nova.compute.manager [req-05eed257-ec60-4fe8-ba2b-137dad159318 req-d814cebf-f39e-4c8a-a36b-a8571ecf73f1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state building and task_state spawning.
Nov 15 16:27:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:27:05 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance spawned successfully.
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:27:05 user nova-compute[75095]: INFO nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Took 4.80 seconds to spawn the instance on the hypervisor.
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:27:05 user nova-compute[75095]: INFO nova.compute.manager [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Took 10.19 seconds to build instance.
Nov 15 16:27:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-3dad16be-7826-42e5-8503-bfaea8eb8bae tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.283s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:27:05 user nova-compute[75095]: DEBUG nova.compute.manager [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:27:05 user nova-compute[75095]: WARNING nova.compute.manager [req-170bbd32-e437-4bb5-a3c0-a4ee9dddc1c3 req-f959d42c-e088-401b-ae1b-0a7cca820c0f service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state active and task_state None.
Nov 15 16:27:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:46 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:27:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:27:50 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:27:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:27:50 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:27:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:27:57 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:27:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:27:58 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=24.356292724609375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 26fd407f-8689-4efe-b2d4-3cef88739e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:27:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:02 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:07 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:12 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:17 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:22 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:28:27 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:37 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:42 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-changed-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing instance network info cache due to event network-changed-976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:28:46 user nova-compute[75095]: DEBUG nova.network.neutron [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG nova.network.neutron [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated VIF entry in instance network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG nova.network.neutron [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-35d1a6d1-c83b-4227-bc57-2524673290b7 req-e2d27886-b12d-4953-8d22-fe3d338858b5 service nova] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:28:47 user nova-compute[75095]: INFO nova.compute.manager [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Shelve offloading
Nov 15 16:28:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:47 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:48 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance destroyed successfully.
Nov 15 16:28:48 user nova-compute[75095]: DEBUG nova.compute.manager [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:28:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:28:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:28:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:28:48 user nova-compute[75095]: DEBUG nova.network.neutron [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:28:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:28:49 user nova-compute[75095]: WARNING nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state active and task_state shelving.
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:28:49 user nova-compute[75095]: WARNING nova.compute.manager [req-fc95dd75-56c1-44b7-9bbf-c10470bb4f70 req-b6e6980e-fb34-4735-b123-80568c0da86e service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state active and task_state shelving.
Nov 15 16:28:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance destroyed successfully.
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'resources' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXZb7oKmMmSD5gmHkxV983kUtx5CiOSwQqKPyfIUNup6wvBswtmXawJvL4VYXzsmYM0UIOnyY3HXhK/iTrP6unt5CF2hXBHAM/TkLdzPtSODwOxw8pvlsfXdKLzKOi8Cw==',key_name='tempest-TestShelveInstance-1020023239',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:27:06Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_vif [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap976b27ea-34, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de125133-f7b1-4797-9cec-0b9d706263d6) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-changed-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing instance network info cache due to event network-changed-976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:28:49 user nova-compute[75095]: INFO os_vif [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34')
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:28:49 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c7a1f-1919-428c-984a-880927d84aad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:28:49 user nova-compute[75095]: No targets found.
Nov 15 16:28:49 user nova-compute[75095]: iSNS:
Nov 15 16:28:49 user nova-compute[75095]: No targets found.
Nov 15 16:28:49 user nova-compute[75095]: STATIC:
Nov 15 16:28:49 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1
Nov 15 16:28:49 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:28:49 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:28:49 user nova-compute[75095]: FIRMWARE:
Nov 15 16:28:49 user nova-compute[75095]: No targets found.
Nov 15 16:28:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:28:49 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:28:49 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade6ec5-befe-4c56-8171-89524d00645b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded87a72-081c-48d7-9908-f2bd0b07335c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:28:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:28:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c45e950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29aa723-f490-41bc-a13c-ad4ad740c018]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdaf771-6946-4ee1-8988-1fc88daccd20]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f196cd-4fa0-43bc-9163-85a6cc37700a]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d3f17d-24d2-4e1b-9faf-d37789651c42]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e4293-d0dd-4daa-82a3-12b90c1f0552]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc997855-3874-448d-954b-6501bb37d792]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]
Nov 15 16:28:49 user nova-compute[75095]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.
Nov 15 16:28:49 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c3edab-2159-4438-899e-e5e896809671]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== disconnect_volume: return (302ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:28:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deleting instance files /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93_del
Nov 15 16:28:49 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deletion of /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93_del complete
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated VIF entry in instance network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:28:49 user nova-compute[75095]: DEBUG nova.network.neutron [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": null, "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap976b27ea-34", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-16c6b4da-4e10-411e-9c8e-3fb55ddd8d72 req-36c33926-0dde-4ce6-a151-0d9346bb9821 service nova] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:28:50 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Deleted allocations for instance 26fd407f-8689-4efe-b2d4-3cef88739e93
Nov 15 16:28:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG nova.objects.instance [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'numa_topology' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG nova.objects.base [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Object Instance<26fd407f-8689-4efe-b2d4-3cef88739e93> lazy-loaded attributes: resources,numa_topology {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.099s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-c1e8a3e3-37f2-441e-aa1f-4c97b8adcf99 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.260s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:51 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:28:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:58 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:28:59 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:29:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:29:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9163MB free_disk=24.35543441772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:29:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:29:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:07 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:07 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:19 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:29:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:19 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:29:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:47 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:29:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:29:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:29:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:29:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:29:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:29:59 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:30:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:30:00 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9186MB free_disk=24.35489273071289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:30:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:30:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:39 user nova-compute[75095]: INFO nova.compute.manager [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Unshelving
Nov 15 16:30:39 user nova-compute[75095]: INFO nova.virt.block_device [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Booting with volume 0ba6394f-15cc-40fb-a83c-e02fa64607d1 at /dev/vda
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.utils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8003c52f-bbe9-4dae-b178-677b6eef57c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6e1adf-f756-4176-984f-6b0121e6ef89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e70d243-7a02-461d-86d3-5de32795633b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd5b06-2947-4e28-9bd3-d8eeec4fa309]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:30:39 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:30:39 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee7cb49-0800-46c6-8d48-d1eb8c004b7d]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG os_brick.utils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:30:39 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating existing volume attachment record: 8cd9f676-5578-4059-be77-aaeb4be08cc0 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:30:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:45 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'pci_requests' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:30:45 user nova-compute[75095]: DEBUG nova.objects.instance [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'numa_topology' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:30:45 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:30:45 user nova-compute[75095]: INFO nova.compute.claims [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Claim successful on node user
Nov 15 16:30:45 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:46 user nova-compute[75095]: INFO nova.network.neutron [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating port 976b27ea-3407-4240-ad29-192a80e3d257 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG nova.network.neutron [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-changed-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG nova.compute.manager [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing instance network info cache due to event network-changed-976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:30:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.network.neutron [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:30:47 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Creating image(s)
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Did not create local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Ensure instance console log exists: /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start _get_guest_xml network_info=[{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'attachment_id': '8cd9f676-5578-4059-be77-aaeb4be08cc0', 'delete_on_termination': True, 'disk_bus': 'virtio', 'boot_index': 0, 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '26fd407f-8689-4efe-b2d4-3cef88739e93', 'attached_at': '', 'detached_at': '', 'volume_id': '0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'serial': '0ba6394f-15cc-40fb-a83c-e02fa64607d1'}, 'guest_format': None, 'volume_type': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.network.neutron [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:30:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:30:47 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.objects.instance [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'vcpu_model' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.objects.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Object Instance<26fd407f-8689-4efe-b2d4-3cef88739e93> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:30:47 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:30:47 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:30:47 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f1f8af-d1b4-40b7-a19f-16110a18a071]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:30:47 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7da4102-c548-4390-ad10-03e633505c76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1] added
Nov 15 16:30:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11a82e8-9d97-4ae6-a84a-86cd544afb38]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94df32-a506-4ff4-bd4a-3faf79d38d3b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEVvlOKX {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DEVvlOKX" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[256224ec-1623-4a0b-bfd1-eb4ac15658a5]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DEVvlOKX'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d0e058-73c4-4f19-ba6c-3628a6333e80]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c0f0ae-5595-42d1-8ed6-2a1803b4b27b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:30:47 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:30:47 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:30:47 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:30:47 user nova-compute[75095]: 
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0389504c-f340-4d3e-ae8e-a7d2f7e43890]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]
Nov 15 16:30:47 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.
Nov 15 16:30:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551b383-ac4a-437e-b4e7-a812cb984ae0]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67582940-3270-4db5-b642-00ed228b42ad]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:30:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:30:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a6fa82-a2a7-4f39-aee8-3d263413066a]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.network.neutron [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated VIF entry in instance network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG nova.network.neutron [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:30:47 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-8b526cfb-8a3f-43ba-98cb-803b4ee5359e req-329d638c-232a-44da-9595-39bf3268b2f8 service nova] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23566323037333166', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566323037333166', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1020023239',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:30:40Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.objects.instance [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'pci_devices' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.objects.base [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Object Instance<26fd407f-8689-4efe-b2d4-3cef88739e93> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75095) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:30:48 user nova-compute[75095]:   <uuid>26fd407f-8689-4efe-b2d4-3cef88739e93</uuid>
Nov 15 16:30:48 user nova-compute[75095]:   <name>instance-00000034</name>
Nov 15 16:30:48 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:30:48 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:30:48 user nova-compute[75095]:   <metadata>
Nov 15 16:30:48 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:30:48 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:30:48 user nova-compute[75095]:       <nova:name>tempest-TestShelveInstance-server-945819856</nova:name>
Nov 15 16:30:48 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:30:47</nova:creationTime>
Nov 15 16:30:48 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:30:48 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:30:48 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:30:48 user nova-compute[75095]:       <nova:owner>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:user uuid="00fcfd9786fc4073b00c7bf417ebae5a">tempest-TestShelveInstance-2112879318-project-member</nova:user>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:project uuid="d115a178396949f3843f91075f0b490a">tempest-TestShelveInstance-2112879318</nova:project>
Nov 15 16:30:48 user nova-compute[75095]:       </nova:owner>
Nov 15 16:30:48 user nova-compute[75095]:       <nova:ports>
Nov 15 16:30:48 user nova-compute[75095]:         <nova:port uuid="976b27ea-3407-4240-ad29-192a80e3d257">
Nov 15 16:30:48 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 16:30:48 user nova-compute[75095]:         </nova:port>
Nov 15 16:30:48 user nova-compute[75095]:       </nova:ports>
Nov 15 16:30:48 user nova-compute[75095]:     </nova:instance>
Nov 15 16:30:48 user nova-compute[75095]:   </metadata>
Nov 15 16:30:48 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:30:48 user nova-compute[75095]:     <system>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="serial">26fd407f-8689-4efe-b2d4-3cef88739e93</entry>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="uuid">26fd407f-8689-4efe-b2d4-3cef88739e93</entry>
Nov 15 16:30:48 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:30:48 user nova-compute[75095]:     </system>
Nov 15 16:30:48 user nova-compute[75095]:   </sysinfo>
Nov 15 16:30:48 user nova-compute[75095]:   <os>
Nov 15 16:30:48 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:30:48 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:30:48 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:30:48 user nova-compute[75095]:   </os>
Nov 15 16:30:48 user nova-compute[75095]:   <features>
Nov 15 16:30:48 user nova-compute[75095]:     <acpi/>
Nov 15 16:30:48 user nova-compute[75095]:     <apic/>
Nov 15 16:30:48 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:30:48 user nova-compute[75095]:   </features>
Nov 15 16:30:48 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:30:48 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:30:48 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:30:48 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:30:48 user nova-compute[75095]:   </clock>
Nov 15 16:30:48 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:30:48 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:30:48 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:30:48 user nova-compute[75095]:   </cpu>
Nov 15 16:30:48 user nova-compute[75095]:   <devices>
Nov 15 16:30:48 user nova-compute[75095]:     <disk type="block" device="disk">
Nov 15 16:30:48 user nova-compute[75095]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:30:48 user nova-compute[75095]:       <source dev="/dev/sdb"/>
Nov 15 16:30:48 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:30:48 user nova-compute[75095]:       <serial>0ba6394f-15cc-40fb-a83c-e02fa64607d1</serial>
Nov 15 16:30:48 user nova-compute[75095]:     </disk>
Nov 15 16:30:48 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:30:48 user nova-compute[75095]:       <mac address="fa:16:3e:6f:27:ae"/>
Nov 15 16:30:48 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:30:48 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:30:48 user nova-compute[75095]:       <target dev="tap976b27ea-34"/>
Nov 15 16:30:48 user nova-compute[75095]:     </interface>
Nov 15 16:30:48 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:30:48 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93/console.log" append="off"/>
Nov 15 16:30:48 user nova-compute[75095]:     </serial>
Nov 15 16:30:48 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:30:48 user nova-compute[75095]:     <video>
Nov 15 16:30:48 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:30:48 user nova-compute[75095]:     </video>
Nov 15 16:30:48 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:30:48 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:30:48 user nova-compute[75095]:     </rng>
Nov 15 16:30:48 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:30:48 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:30:48 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:30:48 user nova-compute[75095]:     </memballoon>
Nov 15 16:30:48 user nova-compute[75095]:   </devices>
Nov 15 16:30:48 user nova-compute[75095]: </domain>
Nov 15 16:30:48 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1020023239',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:27:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:30:40Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG os_vif [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd413c392-2c5d-52d6-b18a-2212b71f749a', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap976b27ea-34, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap976b27ea-34, col_values=(('qos', UUID('2fedb503-b14d-4759-a88d-fef0c47fcade')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap976b27ea-34, col_values=(('external_ids', {'iface-id': '976b27ea-3407-4240-ad29-192a80e3d257', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:27:ae', 'vm-uuid': '26fd407f-8689-4efe-b2d4-3cef88739e93'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:48 user nova-compute[75095]: INFO os_vif [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34')
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:30:48 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] No VIF found with MAC fa:16:3e:6f:27:ae, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:30:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:49 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG nova.compute.manager [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:30:50 user nova-compute[75095]: WARNING nova.compute.manager [req-4c0c0fc8-e851-4d46-a144-0a207c051b71 req-d2411ffa-f9e6-4eb9-bdb2-59d2547bdee9 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 16:30:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:30:52 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance spawned successfully.
Nov 15 16:30:52 user nova-compute[75095]: DEBUG nova.compute.manager [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-dd2691af-1640-4ff2-9e98-357630d2b1d6 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.555s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:30:52 user nova-compute[75095]: DEBUG nova.compute.manager [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:30:52 user nova-compute[75095]: WARNING nova.compute.manager [req-031471af-89e9-4925-8030-300fe2f44d97 req-1408303a-5a3d-408b-848d-34b740998092 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state active and task_state None.
Nov 15 16:30:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:30:53 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:30:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:30:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:30:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:31:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:31:02 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:31:02 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.353424072265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 26fd407f-8689-4efe-b2d4-3cef88739e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:31:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:31:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:49 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:31:54 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:31:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:31:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:32:01 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75095) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 16:32:02 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:32:02 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9035MB free_disk=24.35277557373047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance 26fd407f-8689-4efe-b2d4-3cef88739e93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:32:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:32:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-changed-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG nova.compute.manager [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing instance network info cache due to event network-changed-976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] Acquiring lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] Acquired lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG nova.network.neutron [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Refreshing network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:30 user nova-compute[75095]: INFO nova.compute.manager [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Terminating instance
Nov 15 16:32:30 user nova-compute[75095]: DEBUG nova.compute.manager [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:30 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.compute.manager [req-af0b1c43-1565-43d2-afe0-9b54eaad5451 req-d926f38e-6ee1-40f6-848b-4c8262436deb service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-unplugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:32:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Instance destroyed successfully.
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.objects.instance [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lazy-loading 'resources' on Instance uuid 26fd407f-8689-4efe-b2d4-3cef88739e93 {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T16:26:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-945819856',display_name='tempest-TestShelveInstance-server-945819856',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-945819856',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXZb7oKmMmSD5gmHkxV983kUtx5CiOSwQqKPyfIUNup6wvBswtmXawJvL4VYXzsmYM0UIOnyY3HXhK/iTrP6unt5CF2hXBHAM/TkLdzPtSODwOxw8pvlsfXdKLzKOi8Cw==',key_name='tempest-TestShelveInstance-1020023239',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:30:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d115a178396949f3843f91075f0b490a',ramdisk_id='',reservation_id='r-m6f7f6k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-2112879318',owner_user_name='tempest-TestShelveInstance-2112879318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:30:52Z,user_data=None,user_id='00fcfd9786fc4073b00c7bf417ebae5a',uuid=26fd407f-8689-4efe-b2d4-3cef88739e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converting VIF {"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_vif [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap976b27ea-34, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fedb503-b14d-4759-a88d-fef0c47fcade) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:31 user nova-compute[75095]: INFO os_vif [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:27:ae,bridge_name='br-int',has_traffic_filtering=True,id=976b27ea-3407-4240-ad29-192a80e3d257,network=Network(1f98d3e1-16f0-4c1c-8742-31243a729b99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap976b27ea-34')
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DEVvlOKX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:32:31 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec543f13-14a9-46f2-bad8-697dcd7d621c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:32:31 user nova-compute[75095]: No targets found.
Nov 15 16:32:31 user nova-compute[75095]: iSNS:
Nov 15 16:32:31 user nova-compute[75095]: No targets found.
Nov 15 16:32:31 user nova-compute[75095]: STATIC:
Nov 15 16:32:31 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1
Nov 15 16:32:31 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:32:31 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:32:31 user nova-compute[75095]: FIRMWARE:
Nov 15 16:32:31 user nova-compute[75095]: No targets found.
Nov 15 16:32:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:32:31 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:32:31 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updated VIF entry in instance network info cache for port 976b27ea-3407-4240-ad29-192a80e3d257. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.network.neutron [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [{"id": "976b27ea-3407-4240-ad29-192a80e3d257", "address": "fa:16:3e:6f:27:ae", "network": {"id": "1f98d3e1-16f0-4c1c-8742-31243a729b99", "bridge": "br-int", "label": "tempest-TestShelveInstance-973900455-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d115a178396949f3843f91075f0b490a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap976b27ea-34", "ovs_interfaceid": "976b27ea-3407-4240-ad29-192a80e3d257", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c947f5c0-5e66-4a38-ad5a-67f7732edc29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-a3c1e3bd-7038-45a8-8f88-8cfcaf2162c0 req-895c6b92-3255-4536-ac3a-fa1851abe734 service nova] Releasing lock "refresh_cache-26fd407f-8689-4efe-b2d4-3cef88739e93" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c545b35-beb0-4847-b92b-255304f7c12d]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:32:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 (non-flash)
Nov 15 16:32:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c2323b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d33f8f6-32ae-47f5-9e52-e9a82f0b267e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cac44f-a86d-4d64-8e72-5372cd5508cd]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5488857b-0b07-480b-bcdb-c51550801b25]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26fb8e3-ef95-44eb-9c78-d14b9224d0c5]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccc0547-93c5-431f-9025-343e60ce8ca7]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de2824a-7de4-47d1-8be0-339a28a65137]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260]
Nov 15 16:32:31 user nova-compute[75095]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1, portal: 172.16.0.220,3260] successful.
Nov 15 16:32:31 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ba6394f-15cc-40fb-a83c-e02fa64607d1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab9d269-604b-4af2-bc83-672b6a5878ef]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] <== disconnect_volume: return (291ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:32:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deleting instance files /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93_del
Nov 15 16:32:31 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deletion of /opt/stack/data/nova/instances/26fd407f-8689-4efe-b2d4-3cef88739e93_del complete
Nov 15 16:32:31 user nova-compute[75095]: INFO nova.compute.manager [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 15 16:32:31 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:32:31 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:32:32 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:32:32 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Took 0.50 seconds to deallocate network for instance.
Nov 15 16:32:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-aa0449da-cf05-4bff-92cc-1db1bcd708ea req-1d3d4f14-dfa7-49b4-9940-bbb2fedd4321 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-deleted-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:32:33 user nova-compute[75095]: INFO nova.compute.manager [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Took 0.76 seconds to detach 1 volumes for instance.
Nov 15 16:32:33 user nova-compute[75095]: DEBUG nova.compute.manager [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Deleting volume: 0ba6394f-15cc-40fb-a83c-e02fa64607d1 {{(pid=75095) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] Acquiring lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG nova.compute.manager [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] No waiting events found dispatching network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:32:33 user nova-compute[75095]: WARNING nova.compute.manager [req-1d1739e4-cbd9-42fe-a70f-9fc415b92165 req-c5182e82-55e0-4e6b-acd5-8fc349cabeb1 service nova] [instance: 26fd407f-8689-4efe-b2d4-3cef88739e93] Received unexpected event network-vif-plugged-976b27ea-3407-4240-ad29-192a80e3d257 for instance with vm_state active and task_state deleting.
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:33 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Deleted allocations for instance 26fd407f-8689-4efe-b2d4-3cef88739e93
Nov 15 16:32:33 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-5fd5a10f-20dc-43f4-8fef-d5ad641a8ba1 tempest-TestShelveInstance-2112879318 tempest-TestShelveInstance-2112879318-project-member] Lock "26fd407f-8689-4efe-b2d4-3cef88739e93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.772s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:32:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:32:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:32:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:32:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:32:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:32:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:32:58 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:32:58 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:33:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:33:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:33:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:33:02 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:33:03 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:33:03 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9162MB free_disk=24.351970672607422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:33:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:33:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:14 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:16 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:33:21 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:33:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:31 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:36 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:33:41 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:33:46 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:50 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:50 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:33:51 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:54 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:33:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:33:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:33:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:56 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:57 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:33:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:33:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:33:59 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:01 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:34:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:05 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:34:05 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8867MB free_disk=24.338729858398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:34:05 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:06 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Starting instance... {{(pid=75095) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75095) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 16:34:10 user nova-compute[75095]: INFO nova.compute.claims [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Claim successful on node user
Nov 15 16:34:10 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:10 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Start building networks asynchronously for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Allocating IP information in the background. {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] allocate_for_instance() {{(pid=75095) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 16:34:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Start building block device mappings for instance. {{(pid=75095) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Start spawning the instance on the hypervisor. {{(pid=75095) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Creating instance directory {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 16:34:11 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Creating image(s)
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "/opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "/opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "/opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG nova.policy [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19726dbb76a74e689b19ff138c025eb7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eabfb1b57194c498e9160eae77857aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75095) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.221s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "df5195a66618240fb35ce708d6cdd0a678133003" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.250s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk 1073741824 {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003,backing_fmt=raw /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk 1073741824" returned: 0 in 0.051s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "df5195a66618240fb35ce708d6cdd0a678133003" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df5195a66618240fb35ce708d6cdd0a678133003 --force-share --output=json" returned: 0 in 0.220s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk. size=1073741824 {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG nova.virt.disk.api [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Cannot resize image /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk to a smaller size. {{(pid=75095) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Created local disks {{(pid=75095) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Ensure instance console log exists: /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/console.log {{(pid=75095) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Successfully created port: 84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 16:34:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Successfully updated port: 84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Building network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-changed-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.compute.manager [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Refreshing instance network info cache due to event network-changed-84b44c0f-2900-4c8c-abd5-e0337e5f3100. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Instance cache missing network info. {{(pid=75095) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.neutron [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Instance network_info: |[{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75095) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.neutron [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Refreshing network info cache for port 84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Start _get_guest_xml network_info=[{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'encryption_secret_uuid': None, 'size': 0, 'guest_format': None, 'image_id': '42c1c869-d893-4140-8d14-8f5bfccef902'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 16:34:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:34:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CPU controller missing on host. {{(pid=75095) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.host [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CPU controller found on host. {{(pid=75095) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75095) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T15:38:19Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T15:38:31Z,direct_url=<?>,disk_format='qcow2',id=42c1c869-d893-4140-8d14-8f5bfccef902,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='2132dec5efbf41c8ac7c9ff52a64cc92',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T15:38:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flavor limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Image limits 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flavor pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Image pref 0:0:0 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75095) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Got 1 possible topologies {{(pid=75095) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.hardware [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75095) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2100201884',display_name='tempest-SnapshotDataIntegrityTests-server-2100201884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2100201884',id=53,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuJk1zvs4Oqn0D3M4yuzAoC9Bk167A2ePs899iMC2iRrduseQlBktjF4ai9UInG+1zCkImXJAZl/q2CdiZfIZkFnsrwOkgs6TiqLQnBaWohv56rlHC1jrTp3yhuEmVprQ==',key_name='tempest-keypair-1962988108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eabfb1b57194c498e9160eae77857aa',ramdisk_id='',reservation_id='r-9l02bmas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1017312975',owner_user_name='tempest-SnapshotDataIntegrityTests-1017312975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19726dbb76a74e689b19ff138c025eb7',uuid=b22c5688-84ed-42d3-a7cd-f139d7a77b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75095) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converting VIF {"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'pci_devices' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 16:34:13 user nova-compute[75095]:   <uuid>b22c5688-84ed-42d3-a7cd-f139d7a77b7c</uuid>
Nov 15 16:34:13 user nova-compute[75095]:   <name>instance-00000035</name>
Nov 15 16:34:13 user nova-compute[75095]:   <memory>524288</memory>
Nov 15 16:34:13 user nova-compute[75095]:   <vcpu>1</vcpu>
Nov 15 16:34:13 user nova-compute[75095]:   <metadata>
Nov 15 16:34:13 user nova-compute[75095]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 16:34:13 user nova-compute[75095]:       <nova:package version="0.0.0"/>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2100201884</nova:name>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:creationTime>2023-11-15 16:34:13</nova:creationTime>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:flavor name="m1.tiny">
Nov 15 16:34:13 user nova-compute[75095]:         <nova:memory>512</nova:memory>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:disk>1</nova:disk>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:swap>0</nova:swap>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:vcpus>1</nova:vcpus>
Nov 15 16:34:13 user nova-compute[75095]:       </nova:flavor>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:owner>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:user uuid="19726dbb76a74e689b19ff138c025eb7">tempest-SnapshotDataIntegrityTests-1017312975-project-member</nova:user>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:project uuid="5eabfb1b57194c498e9160eae77857aa">tempest-SnapshotDataIntegrityTests-1017312975</nova:project>
Nov 15 16:34:13 user nova-compute[75095]:       </nova:owner>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:root type="image" uuid="42c1c869-d893-4140-8d14-8f5bfccef902"/>
Nov 15 16:34:13 user nova-compute[75095]:       <nova:ports>
Nov 15 16:34:13 user nova-compute[75095]:         <nova:port uuid="84b44c0f-2900-4c8c-abd5-e0337e5f3100">
Nov 15 16:34:13 user nova-compute[75095]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 16:34:13 user nova-compute[75095]:         </nova:port>
Nov 15 16:34:13 user nova-compute[75095]:       </nova:ports>
Nov 15 16:34:13 user nova-compute[75095]:     </nova:instance>
Nov 15 16:34:13 user nova-compute[75095]:   </metadata>
Nov 15 16:34:13 user nova-compute[75095]:   <sysinfo type="smbios">
Nov 15 16:34:13 user nova-compute[75095]:     <system>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="product">OpenStack Nova</entry>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="version">0.0.0</entry>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="serial">b22c5688-84ed-42d3-a7cd-f139d7a77b7c</entry>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="uuid">b22c5688-84ed-42d3-a7cd-f139d7a77b7c</entry>
Nov 15 16:34:13 user nova-compute[75095]:       <entry name="family">Virtual Machine</entry>
Nov 15 16:34:13 user nova-compute[75095]:     </system>
Nov 15 16:34:13 user nova-compute[75095]:   </sysinfo>
Nov 15 16:34:13 user nova-compute[75095]:   <os>
Nov 15 16:34:13 user nova-compute[75095]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 16:34:13 user nova-compute[75095]:     <boot dev="hd"/>
Nov 15 16:34:13 user nova-compute[75095]:     <smbios mode="sysinfo"/>
Nov 15 16:34:13 user nova-compute[75095]:   </os>
Nov 15 16:34:13 user nova-compute[75095]:   <features>
Nov 15 16:34:13 user nova-compute[75095]:     <acpi/>
Nov 15 16:34:13 user nova-compute[75095]:     <apic/>
Nov 15 16:34:13 user nova-compute[75095]:     <vmcoreinfo/>
Nov 15 16:34:13 user nova-compute[75095]:   </features>
Nov 15 16:34:13 user nova-compute[75095]:   <clock offset="utc">
Nov 15 16:34:13 user nova-compute[75095]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 16:34:13 user nova-compute[75095]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 16:34:13 user nova-compute[75095]:     <timer name="hpet" present="no"/>
Nov 15 16:34:13 user nova-compute[75095]:   </clock>
Nov 15 16:34:13 user nova-compute[75095]:   <cpu mode="custom" match="exact">
Nov 15 16:34:13 user nova-compute[75095]:     <model>Nehalem</model>
Nov 15 16:34:13 user nova-compute[75095]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 16:34:13 user nova-compute[75095]:   </cpu>
Nov 15 16:34:13 user nova-compute[75095]:   <devices>
Nov 15 16:34:13 user nova-compute[75095]:     <disk type="file" device="disk">
Nov 15 16:34:13 user nova-compute[75095]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 16:34:13 user nova-compute[75095]:       <source file="/opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk"/>
Nov 15 16:34:13 user nova-compute[75095]:       <target dev="vda" bus="virtio"/>
Nov 15 16:34:13 user nova-compute[75095]:     </disk>
Nov 15 16:34:13 user nova-compute[75095]:     <interface type="ethernet">
Nov 15 16:34:13 user nova-compute[75095]:       <mac address="fa:16:3e:7d:1b:d1"/>
Nov 15 16:34:13 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:34:13 user nova-compute[75095]:       <mtu size="1442"/>
Nov 15 16:34:13 user nova-compute[75095]:       <target dev="tap84b44c0f-29"/>
Nov 15 16:34:13 user nova-compute[75095]:     </interface>
Nov 15 16:34:13 user nova-compute[75095]:     <serial type="pty">
Nov 15 16:34:13 user nova-compute[75095]:       <log file="/opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/console.log" append="off"/>
Nov 15 16:34:13 user nova-compute[75095]:     </serial>
Nov 15 16:34:13 user nova-compute[75095]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 16:34:13 user nova-compute[75095]:     <video>
Nov 15 16:34:13 user nova-compute[75095]:       <model type="virtio"/>
Nov 15 16:34:13 user nova-compute[75095]:     </video>
Nov 15 16:34:13 user nova-compute[75095]:     <rng model="virtio">
Nov 15 16:34:13 user nova-compute[75095]:       <backend model="random">/dev/urandom</backend>
Nov 15 16:34:13 user nova-compute[75095]:     </rng>
Nov 15 16:34:13 user nova-compute[75095]:     <controller type="usb" index="0" model="none"/>
Nov 15 16:34:13 user nova-compute[75095]:     <memballoon model="virtio">
Nov 15 16:34:13 user nova-compute[75095]:       <stats period="10"/>
Nov 15 16:34:13 user nova-compute[75095]:     </memballoon>
Nov 15 16:34:13 user nova-compute[75095]:   </devices>
Nov 15 16:34:13 user nova-compute[75095]: </domain>
Nov 15 16:34:13 user nova-compute[75095]:  {{(pid=75095) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2100201884',display_name='tempest-SnapshotDataIntegrityTests-server-2100201884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2100201884',id=53,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuJk1zvs4Oqn0D3M4yuzAoC9Bk167A2ePs899iMC2iRrduseQlBktjF4ai9UInG+1zCkImXJAZl/q2CdiZfIZkFnsrwOkgs6TiqLQnBaWohv56rlHC1jrTp3yhuEmVprQ==',key_name='tempest-keypair-1962988108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5eabfb1b57194c498e9160eae77857aa',ramdisk_id='',reservation_id='r-9l02bmas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1017312975',owner_user_name='tempest-SnapshotDataIntegrityTests-1017312975-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T16:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19726dbb76a74e689b19ff138c025eb7',uuid=b22c5688-84ed-42d3-a7cd-f139d7a77b7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converting VIF {"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG os_vif [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29') {{(pid=75095) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a126cca6-0d48-5e4a-b207-e556247706a2', '_type': 'linux-noop'}}, row=False) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84b44c0f-29, may_exist=True, interface_attrs={}) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84b44c0f-29, col_values=(('qos', UUID('c1c9ccee-664c-4256-b376-b47de549386d')),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84b44c0f-29, col_values=(('external_ids', {'iface-id': '84b44c0f-2900-4c8c-abd5-e0337e5f3100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:1b:d1', 'vm-uuid': 'b22c5688-84ed-42d3-a7cd-f139d7a77b7c'}),), if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:13 user nova-compute[75095]: INFO os_vif [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29')
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:34:13 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No VIF found with MAC fa:16:3e:7d:1b:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:34:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated VIF entry in instance network info cache for port 84b44c0f-2900-4c8c-abd5-e0337e5f3100. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:34:14 user nova-compute[75095]: DEBUG nova.network.neutron [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:34:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-48958ce7-9c93-4d7a-b7ae-9b2b163cf981 req-6417a30a-c06f-4571-b2cd-bdebde52200b service nova] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG nova.compute.manager [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] No waiting events found dispatching network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:34:15 user nova-compute[75095]: WARNING nova.compute.manager [req-dec07d8e-858d-4050-95e5-7014f6d1dc62 req-bc3eaf5c-d222-44d2-a6ee-ddf598684712 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received unexpected event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 for instance with vm_state building and task_state spawning.
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:15 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.compute.manager [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] No waiting events found dispatching network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:34:17 user nova-compute[75095]: WARNING nova.compute.manager [req-f052ec75-5882-46ef-9d03-923f45091f02 req-5cb4ecd6-8b89-4943-8686-9bc4b14d5729 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received unexpected event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 for instance with vm_state building and task_state spawning.
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Instance event wait completed in 0 seconds for  {{(pid=75095) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Guest created on hypervisor {{(pid=75095) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 16:34:17 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Instance spawned successfully.
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_cdrom_bus of ide {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_disk_bus of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_input_bus of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_pointer_model of None {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_video_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Found default for hw_vif_model of virtio {{(pid=75095) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 16:34:17 user nova-compute[75095]: INFO nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Took 6.29 seconds to spawn the instance on the hypervisor.
Nov 15 16:34:17 user nova-compute[75095]: DEBUG nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Checking state {{(pid=75095) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 16:34:17 user nova-compute[75095]: INFO nova.compute.manager [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Took 6.97 seconds to build instance.
Nov 15 16:34:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f2f249be-d812-4700-a2c4-cc8db10427f9 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.096s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:34:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:34:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:34:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:39 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:44 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:52 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:34:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:34:55 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:34:56 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:34:56 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:34:56 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:34:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:34:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:34:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:34:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:35:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:35:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:35:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:35:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=24.306663513183594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:35:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:51 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:35:57 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:35:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-changed-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG nova.compute.manager [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Refreshing instance network info cache due to event network-changed-84b44c0f-2900-4c8c-abd5-e0337e5f3100. {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG nova.network.neutron [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Refreshing network info cache for port 84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 16:36:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated VIF entry in instance network info cache for port 84b44c0f-2900-4c8c-abd5-e0337e5f3100. {{(pid=75095) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 16:36:02 user nova-compute[75095]: DEBUG nova.network.neutron [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:36:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-cea79aa0-36b5-490e-8e24-9040b92acad6 req-12739e36-ab6c-44a0-90f6-11755878eaf3 service nova] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:36:03 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:36:04 user nova-compute[75095]: INFO nova.compute.manager [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attaching volume e2bfc15a-451c-461b-8230-c8122ec9a973 to /dev/vdb
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.utils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23815b0e-2bcf-4df8-9faa-672bbc884cb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[57565100-b41d-4bab-85e6-594a91ba45d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d0d26-e955-416e-858e-587bd043262f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e28a3b-dc11-4824-9ef8-41a839e76654]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:36:04 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:36:04 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27067203-aca7-406d-ae3d-3f5001ae375e]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG os_brick.utils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating existing volume attachment record: b7e8de9b-5cde-474b-8aba-54aa854468aa {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:36:04 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:36:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8985MB free_disk=24.305927276611328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:36:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGLsbWKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:36:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:36:08 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:36:08 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b62112-d294-42f3-96c1-e3947fd7159c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:36:08 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c6961-2444-4990-a432-0f4519001321]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973] added
Nov 15 16:36:08 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f3558-7110-4638-bb72-0d96eacc91ab]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b8a6b-0203-4762-b93a-8aad70f70efa]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGLsbWKi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGLsbWKi" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddce3d3-979c-4014-8196-6d5f80d0431b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGLsbWKi'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a94d18e-267e-456d-815b-feb945c20a88]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13442713-aaef-4b75-9800-ce1964b17901]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:36:09 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:36:09 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:36:09 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:36:09 user nova-compute[75095]: 
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec2444-86ec-4df4-b2cb-29020a1afc97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260]
Nov 15 16:36:09 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260] successful.
Nov 15 16:36:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3c2051-7f1b-47b0-9ac1-8e51071a6157]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bec491-19cd-4804-a56f-3f7a4a884a20]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)
Nov 15 16:36:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)
Nov 15 16:36:09 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d492c8-d57a-4116-9fe8-75c5f60822e4]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:36:09 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGLsbWKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23261643335633861', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261643335633861', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:36:10 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:36:10 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:36:10 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:36:10 user nova-compute[75095]:   <serial>e2bfc15a-451c-461b-8230-c8122ec9a973</serial>
Nov 15 16:36:10 user nova-compute[75095]: </disk>
Nov 15 16:36:10 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No VIF found with MAC fa:16:3e:7d:1b:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:36:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e2c70191-c432-46fa-81b0-56ad07f97341 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.498s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:36:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:36:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:36:22 user nova-compute[75095]: INFO nova.compute.manager [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Detaching volume e2bfc15a-451c-461b-8230-c8122ec9a973
Nov 15 16:36:22 user nova-compute[75095]: INFO nova.virt.block_device [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attempting to driver detach volume e2bfc15a-451c-461b-8230-c8122ec9a973 from mountpoint /dev/vdb
Nov 15 16:36:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Attempting to detach device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:36:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:36:22 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:36:22 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:36:22 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:36:22 user nova-compute[75095]:   <serial>e2bfc15a-451c-461b-8230-c8122ec9a973</serial>
Nov 15 16:36:22 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:36:22 user nova-compute[75095]: </disk>
Nov 15 16:36:22 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:36:22 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config.
Nov 15 16:36:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:36:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:36:22 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:36:22 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:36:22 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:36:22 user nova-compute[75095]:   <serial>e2bfc15a-451c-461b-8230-c8122ec9a973</serial>
Nov 15 16:36:22 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:36:22 user nova-compute[75095]: </disk>
Nov 15 16:36:22 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:36:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:36:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:34 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:42 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c is timed out.
Nov 15 16:36:42 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config.
Nov 15 16:36:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGLsbWKi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:36:42 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52c217d-60a5-438e-a728-d762d5526b23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:36:42 user nova-compute[75095]: No targets found.
Nov 15 16:36:42 user nova-compute[75095]: iSNS:
Nov 15 16:36:42 user nova-compute[75095]: No targets found.
Nov 15 16:36:42 user nova-compute[75095]: STATIC:
Nov 15 16:36:42 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973
Nov 15 16:36:42 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:36:42 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:36:42 user nova-compute[75095]: FIRMWARE:
Nov 15 16:36:42 user nova-compute[75095]: No targets found.
Nov 15 16:36:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:36:42 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:36:42 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[822bf57d-8a4d-4bce-856f-c030b7fdc4f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf2c23-1a18-4cb3-9fcf-58833c18082c]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)
Nov 15 16:36:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 (non-flash)
Nov 15 16:36:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c66a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c6f41-6399-4057-802f-21af7f897f4b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6521c82d-aada-4778-9b6c-e7afb400e08d]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95dbf1-344b-4d11-b0dd-2e9b219f5726]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[807df76b-67be-44dd-a5e9-9499bf2dabd2]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[248f69a0-71ed-4ee7-8dff-be2f2b0ac451]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7db85-452d-49e2-b43c-1f7103753bdc]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260]
Nov 15 16:36:42 user nova-compute[75095]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973, portal: 172.16.0.220,3260] successful.
Nov 15 16:36:42 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2bfc15a-451c-461b-8230-c8122ec9a973 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5b8d89-7d1f-4793-ae1f-4b5a2db7b82e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== disconnect_volume: return (309ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:36:42 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG nova.objects.instance [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-757c9f36-33d0-4366-a49f-b13285ac0e07 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.582s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:36:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:36:59 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:37:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:37:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:37:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:37:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:01 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:37:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:06 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:37:07 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9022MB free_disk=24.30474853515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:37:07 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:37:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:37:14 user nova-compute[75095]: INFO nova.compute.manager [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attaching volume 50853db7-0e92-42fa-a7c7-b2fa1e7b793d to /dev/vdb
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.utils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f16c571-5fbc-421e-844e-456c93243667]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9b7abf-678f-481e-9c7e-29c0e8adc118]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5df647-c072-4b5d-a825-6cc26a346953]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[936c6de6-9e9d-41b0-8054-834adc8ac25e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:37:14 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:37:14 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e335fe1-f9a2-4b51-b12d-8a64a73bac02]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG os_brick.utils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating existing volume attachment record: c609e067-db84-41dc-8d51-0ef27882ac06 {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:37:14 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMIbUJSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:37:18 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:37:18 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:37:18 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d59e35-e801-458c-8026-1cd2e9d104ed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:37:18 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[206bf3a8-2e66-4149-9036-9e888ac5b5b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:18 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d] added
Nov 15 16:37:18 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2135b8-b720-42c1-9bd9-f99f36c9702e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[202b918e-d608-40d3-875b-9f1377e8d932]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMIbUJSp {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMIbUJSp" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67ef9b8-48b0-45d4-8215-ae429664cca8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMIbUJSp'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f48f7b2-9d56-4ca9-bbc0-8cc2b3c13f44]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e126b2c-d4d7-4322-b720-9d4ffb2f938c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:37:19 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:37:19 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:37:19 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:37:19 user nova-compute[75095]: 
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42120f-84ea-4d22-aa86-d8a2bf3a2e8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260]
Nov 15 16:37:19 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260] successful.
Nov 15 16:37:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e48e15-040d-42d2-826d-ee23e3b97cc8]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[717fcea9-ad4d-42d8-8fd6-954a3c769a1f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)
Nov 15 16:37:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)
Nov 15 16:37:19 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[576e6225-56b2-4d29-b07f-04a10b05280b]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:37:19 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMIbUJSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23966363764323961', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363764323961', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.objects.instance [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:37:20 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:37:20 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:37:20 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:37:20 user nova-compute[75095]:   <serial>50853db7-0e92-42fa-a7c7-b2fa1e7b793d</serial>
Nov 15 16:37:20 user nova-compute[75095]: </disk>
Nov 15 16:37:20 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No VIF found with MAC fa:16:3e:7d:1b:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:37:20 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-8e9442e4-b94e-466d-9f00-c77172e47105 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.517s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:37:23 user nova-compute[75095]: INFO nova.compute.manager [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Detaching volume 50853db7-0e92-42fa-a7c7-b2fa1e7b793d
Nov 15 16:37:23 user nova-compute[75095]: INFO nova.virt.block_device [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attempting to driver detach volume 50853db7-0e92-42fa-a7c7-b2fa1e7b793d from mountpoint /dev/vdb
Nov 15 16:37:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Attempting to detach device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:37:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:37:23 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:37:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:37:23 user nova-compute[75095]:   <serial>50853db7-0e92-42fa-a7c7-b2fa1e7b793d</serial>
Nov 15 16:37:23 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:37:23 user nova-compute[75095]: </disk>
Nov 15 16:37:23 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:37:23 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config.
Nov 15 16:37:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:37:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:37:23 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:37:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:37:23 user nova-compute[75095]:   <serial>50853db7-0e92-42fa-a7c7-b2fa1e7b793d</serial>
Nov 15 16:37:23 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:37:23 user nova-compute[75095]: </disk>
Nov 15 16:37:23 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:37:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:43 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c is timed out.
Nov 15 16:37:43 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config.
Nov 15 16:37:43 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMIbUJSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:37:43 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68629ee-3088-4628-a05a-f1c52397869b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:37:43 user nova-compute[75095]: No targets found.
Nov 15 16:37:43 user nova-compute[75095]: iSNS:
Nov 15 16:37:43 user nova-compute[75095]: No targets found.
Nov 15 16:37:43 user nova-compute[75095]: STATIC:
Nov 15 16:37:43 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d
Nov 15 16:37:43 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:37:43 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:37:43 user nova-compute[75095]: FIRMWARE:
Nov 15 16:37:43 user nova-compute[75095]: No targets found.
Nov 15 16:37:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:37:43 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:37:43 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5343cdc0-313e-4bbb-8c1b-909134e98dd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9751c5d-2ac9-47e0-b8c9-5f92e1d39584]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)
Nov 15 16:37:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d (non-flash)
Nov 15 16:37:43 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c36f1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2098af86-858a-4707-9f65-d04308a5cec6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[370fc798-2d31-4992-a1f9-72faf71b328b]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:37:43 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45746214-1d78-4022-8a9d-059057f5d47b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e519960f-73b7-4f1b-a977-39aa7330d383]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18d186a-6d62-4b99-a3e3-fdb525afb364]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca5391-4881-440a-9be5-362823f0d27b]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260]
Nov 15 16:37:44 user nova-compute[75095]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d, portal: 172.16.0.220,3260] successful.
Nov 15 16:37:44 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50853db7-0e92-42fa-a7c7-b2fa1e7b793d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7470c7f4-53f0-4425-a4c4-e399712c9d54]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== disconnect_volume: return (284ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:37:44 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e74dae18-0bb6-47ec-8e8a-cac779adb8fd tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.568s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:37:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:37:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:37:59 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:38:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:38:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:38:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:38:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:08 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:09 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:38:09 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9008MB free_disk=24.303836822509766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:38:09 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:38:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:38:15 user nova-compute[75095]: INFO nova.compute.manager [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attaching volume 367649cb-5a88-4af0-830a-11521d6c1891 to /dev/vdb
Nov 15 16:38:15 user nova-compute[75095]: DEBUG os_brick.utils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:38:15 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9831673c-e417-4d3b-b0f7-c415e513eea2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b93568-d695-4736-9638-5ece699f92f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f1c69-3651-498b-8eac-5d5af2314420]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d31057-192e-4c99-8970-e3e5798cdb50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:38:16 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:38:16 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b722eb-49d1-4174-b44b-036dc6f5bac2]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG os_brick.utils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:38:16 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating existing volume attachment record: 81f2c5b2-ed67-42f0-908b-3b692fba451e {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:38:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLtolSFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:38:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:38:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:38:20 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d801ad-cf08-4b87-a51f-5fe49cf6eb48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:38:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[556567c2-f441-4544-a180-ab086d5b8f7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891] added
Nov 15 16:38:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4ee312-d4b8-4ace-859d-89705f95ac3f]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6038292c-add7-40a1-b85a-5f1dd772153b]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLtolSFO {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLtolSFO" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea4c24-613d-4b16-bb22-69352cc4b9c1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLtolSFO'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20a53b1-a6e9-4789-a1ea-dc81c4b5a909]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[02859cf8-2c98-4528-bae7-a44b59fa5ffe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:38:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:38:20 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:38:20 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:38:20 user nova-compute[75095]: 
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffae2cac-e61a-41c0-9884-8c511e891c06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260]
Nov 15 16:38:20 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260] successful.
Nov 15 16:38:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[131154b5-6e46-49cb-a8eb-3cfa2a5ab8d6]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5850211-bb64-42f3-acbb-d0687eff680c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)
Nov 15 16:38:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)
Nov 15 16:38:20 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d30f289-16d2-4c4f-960b-4c7d38ee0f8f]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:38:20 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLtolSFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:38:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.291s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:38:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26233396431383765', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:38:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233396431383765', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:38:21 user nova-compute[75095]: DEBUG nova.objects.instance [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:38:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:38:21 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:38:21 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:38:21 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:38:21 user nova-compute[75095]:   <serial>367649cb-5a88-4af0-830a-11521d6c1891</serial>
Nov 15 16:38:21 user nova-compute[75095]: </disk>
Nov 15 16:38:21 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:38:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:38:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:38:22 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No VIF found with MAC fa:16:3e:7d:1b:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:38:22 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-f37c58f9-96d0-4fa2-83e5-9d105c318d71 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.513s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:38:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:38:25 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:38:25 user nova-compute[75095]: INFO nova.compute.manager [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Detaching volume 367649cb-5a88-4af0-830a-11521d6c1891
Nov 15 16:38:25 user nova-compute[75095]: INFO nova.virt.block_device [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attempting to driver detach volume 367649cb-5a88-4af0-830a-11521d6c1891 from mountpoint /dev/vdb
Nov 15 16:38:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Attempting to detach device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:38:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:38:25 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:38:25 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:38:25 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:38:25 user nova-compute[75095]:   <serial>367649cb-5a88-4af0-830a-11521d6c1891</serial>
Nov 15 16:38:25 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:38:25 user nova-compute[75095]: </disk>
Nov 15 16:38:25 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:38:25 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config.
Nov 15 16:38:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:38:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:38:25 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:38:25 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:38:25 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:38:25 user nova-compute[75095]:   <serial>367649cb-5a88-4af0-830a-11521d6c1891</serial>
Nov 15 16:38:25 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:38:25 user nova-compute[75095]: </disk>
Nov 15 16:38:25 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:38:25 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:38:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:45 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c is timed out.
Nov 15 16:38:45 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config.
Nov 15 16:38:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLtolSFO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:38:45 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca22e617-2a8e-49a7-af84-45ad398b8acb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:38:45 user nova-compute[75095]: No targets found.
Nov 15 16:38:45 user nova-compute[75095]: iSNS:
Nov 15 16:38:45 user nova-compute[75095]: No targets found.
Nov 15 16:38:45 user nova-compute[75095]: STATIC:
Nov 15 16:38:45 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891
Nov 15 16:38:45 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:38:45 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:38:45 user nova-compute[75095]: FIRMWARE:
Nov 15 16:38:45 user nova-compute[75095]: No targets found.
Nov 15 16:38:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:38:45 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:38:45 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[192385a2-62bb-4f1f-9d1d-67edaf8807d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c00c12-1c9e-40c2-9989-c042470690cb]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)
Nov 15 16:38:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 (non-flash)
Nov 15 16:38:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c36f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a376a012-ae01-4eeb-b00e-2649aaebc332]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101cefb-2e57-4a51-a3ef-30098e05d58a]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2d06fd-9927-4b06-8d66-6fb2c467ec54]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ebd80-45bc-446c-b84f-a3c99788733b]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda058cd-5640-4e61-ad01-6c22791a10bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d8a8a5-ebed-4451-b736-f774d4e0f9b9]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260]
Nov 15 16:38:45 user nova-compute[75095]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891, portal: 172.16.0.220,3260] successful.
Nov 15 16:38:45 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:367649cb-5a88-4af0-830a-11521d6c1891 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564fb63-ff83-469b-8569-45e80b375330]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== disconnect_volume: return (288ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:38:45 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:38:46 user nova-compute[75095]: DEBUG nova.objects.instance [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:38:46 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-9a4a70c8-11f4-4769-99e9-db1aee2f5753 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.594s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:38:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:50 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:50 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75095) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 16:38:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:54 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:38:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:39:00 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:39:01 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:39:01 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:39:01 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:39:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:06 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:39:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:09 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:39:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9019MB free_disk=24.2950439453125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing inventories for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating ProviderTree inventory for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Updating inventory in ProviderTree for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing aggregate associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, aggregates: None {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Refreshing trait associations for resource provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c, traits: COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_USB,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG {{(pid=75095) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:39:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:39:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG nova.objects.instance [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:39:17 user nova-compute[75095]: INFO nova.compute.manager [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attaching volume 569d9010-ae83-4ae7-8fed-79b5706d2398 to /dev/vdb
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.utils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[049c34ac-958d-40af-b8ca-aba5ea35ebe8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:beecb2664ecf\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e54244-5eb9-4c05-84e6-d8ae78503ffe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0ca40d-e13d-46cf-a33b-abcd9d885668]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac4d972-3a10-47f3-bb31-3a5e7e7537bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Running cmd (subprocess): nvme version {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] 'nvme version' failed. Not Retrying. {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.nvmeof [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] nvme not present on system {{(pid=75095) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 16:39:17 user nova-compute[75095]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 16:39:17 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d256bd32-9481-44ad-8129-80993f8d7fdc]: (4, '') {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75095) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.lightos [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] LIGHTOS: no hostnqn found. {{(pid=75095) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG os_brick.utils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:beecb2664ecf', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:39:17 user nova-compute[75095]: DEBUG nova.virt.block_device [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating existing volume attachment record: 38901f76-5c93-4063-9339-46fb5a1236eb {{(pid=75095) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 16:39:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:19 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:20 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Calling os-brick to attach iSCSI Volume {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxlAbCKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:39:21 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:39:21 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:39:21 user nova-compute[75095]: INFO os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f380837-8e17-4de8-a4e1-795948c78223]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 16:39:21 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --interface default --op new {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[05abdccc-dbca-40d7-bc9d-1259677ccec3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398] added\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398] added
Nov 15 16:39:21 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc12f39-c01c-407d-94c8-b9f2161a615e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:21 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5b2590-876a-4da7-9a63-8334973288bf]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxlAbCKj {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxlAbCKj" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3812119b-42a7-4fb4-992a-343827a6bd6e]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxlAbCKj'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.154s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c630c48-08e4-4804-98ad-caf9e4b2e8a1]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b38cbce-4210-457b-83d6-db811f8b6fa9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:39:22 user nova-compute[75095]:  {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 16:39:22 user nova-compute[75095]:  {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:39:22 user nova-compute[75095]: WARNING os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 16:39:22 user nova-compute[75095]: 
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --login {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cf5d97-708b-4a32-8e29-6a8c00df0ba4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260]
Nov 15 16:39:22 user nova-compute[75095]: Login to [iface: default, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260] successful.
Nov 15 16:39:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a12b461-60e1-4bdf-a3e5-cda2dc5afc10]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2216231b-1df5-4795-b22d-f1b60fe95693]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)
Nov 15 16:39:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)
Nov 15 16:39:22 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to 172.16.0.220:3260 {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75095) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75095) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be4e2a3-149f-4b9f-9883-e44346e6d784]: (4, ('- - 0', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75095) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 16:39:22 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxlAbCKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75095) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '26438356132323932', 'path': '/dev/sdb'} {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438356132323932', 'path': '/dev/sdb'} {{(pid=75095) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.objects.instance [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 16:39:23 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:39:23 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:39:23 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:39:23 user nova-compute[75095]:   <serial>569d9010-ae83-4ae7-8fed-79b5706d2398</serial>
Nov 15 16:39:23 user nova-compute[75095]: </disk>
Nov 15 16:39:23 user nova-compute[75095]:  {{(pid=75095) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vda, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75095) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] No VIF found with MAC fa:16:3e:7d:1b:d1, not building metadata {{(pid=75095) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-482b2aaf-e294-48e2-b98f-18c5915094ef tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.598s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:39:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:24 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:39:26 user nova-compute[75095]: INFO nova.compute.manager [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Detaching volume 569d9010-ae83-4ae7-8fed-79b5706d2398
Nov 15 16:39:26 user nova-compute[75095]: INFO nova.virt.block_device [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Attempting to driver detach volume 569d9010-ae83-4ae7-8fed-79b5706d2398 from mountpoint /dev/vdb
Nov 15 16:39:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Attempting to detach device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config. {{(pid=75095) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:39:26 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:39:26 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:39:26 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:39:26 user nova-compute[75095]:   <serial>569d9010-ae83-4ae7-8fed-79b5706d2398</serial>
Nov 15 16:39:26 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:39:26 user nova-compute[75095]: </disk>
Nov 15 16:39:26 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:39:26 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the persistent domain config.
Nov 15 16:39:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config. {{(pid=75095) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.guest [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 16:39:26 user nova-compute[75095]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 16:39:26 user nova-compute[75095]:   <source dev="/dev/sdb"/>
Nov 15 16:39:26 user nova-compute[75095]:   <target dev="vdb" bus="virtio"/>
Nov 15 16:39:26 user nova-compute[75095]:   <serial>569d9010-ae83-4ae7-8fed-79b5706d2398</serial>
Nov 15 16:39:26 user nova-compute[75095]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 16:39:26 user nova-compute[75095]: </disk>
Nov 15 16:39:26 user nova-compute[75095]:  {{(pid=75095) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:26 user nova-compute[75095]: DEBUG nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 16:39:28 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Cleaning up deleted instances {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 16:39:28 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] There are 0 instances to clean {{(pid=75095) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 16:39:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:46 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c is timed out.
Nov 15 16:39:46 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully detached device vdb from instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c from the live domain config.
Nov 15 16:39:46 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] calling os-brick to detach iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f595c1c8340>, {'target_iqn': 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxlAbCKj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 16:39:46 user nova-compute[75095]: WARNING os_brick.initiator.connectors.base [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790d6c9-ebf2-48ea-a845-17f1257ede31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 16:39:46 user nova-compute[75095]: No targets found.
Nov 15 16:39:46 user nova-compute[75095]: iSNS:
Nov 15 16:39:46 user nova-compute[75095]: No targets found.
Nov 15 16:39:46 user nova-compute[75095]: STATIC:
Nov 15 16:39:46 user nova-compute[75095]: Target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398
Nov 15 16:39:46 user nova-compute[75095]:         Portal: 172.16.0.220:3260,-1
Nov 15 16:39:46 user nova-compute[75095]:                 Iface Name: default
Nov 15 16:39:46 user nova-compute[75095]: FIRMWARE:
Nov 15 16:39:46 user nova-compute[75095]: No targets found.
Nov 15 16:39:46 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 16:39:46 user nova-compute[75095]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 16:39:46 user nova-compute[75095]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75095) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398', 0)] {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[37371532-52a5-4771-beef-8448ad9c4fed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803ff1c-ed8f-435a-bff0-dce943ec089e]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)
Nov 15 16:39:46 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 (non-flash)
Nov 15 16:39:46 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f593c45d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398'): ({'sdb'}, set())}) {{(pid=75095) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Removing single pathed devices sdb {{(pid=75095) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 16:39:46 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f351eb-b56f-4120-98bd-542da64d243c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af14bb3f-e997-4016-8643-15fbe9205c14]: (4, ('ok\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Flushing IO for device /dev/sdb {{(pid=75095) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e18524-f9a8-4ee9-92e5-2766ba320470]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75095) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27da297-07a6-432f-8f84-33d99fd0f376]: (4, ('1', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.linuxscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] SCSI volumes sdb have been removed. {{(pid=75095) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398')] {{(pid=75095) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4474ed93-105f-4bf9-9625-d6e4f1195621]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --logout {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bad9316-808d-4e26-9e9c-5feb1e5114f8]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260]
Nov 15 16:39:47 user nova-compute[75095]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398, portal: 172.16.0.220,3260] successful.
Nov 15 16:39:47 user nova-compute[75095]:  stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op delete {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:569d9010-ae83-4ae7-8fed-79b5706d2398 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85634) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG oslo.privsep.daemon [-] privsep: reply[600bbdf6-5752-4294-8dbb-b06b248c8742]: (4, ('', '')) {{(pid=85634) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75095) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.base [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] <== disconnect_volume: return (273ms) None {{(pid=75095) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 16:39:47 user nova-compute[75095]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Disconnected iSCSI Volume {{(pid=75095) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG nova.objects.instance [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'flavor' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-e04c8de4-8db0-48cf-a72f-712309802837 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.673s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:39:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:39:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquired lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Forcefully refreshing network info cache for instance {{(pid=75095) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 16:40:02 user nova-compute[75095]: DEBUG nova.objects.instance [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lazy-loading 'info_cache' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:40:03 user nova-compute[75095]: DEBUG nova.network.neutron [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [{"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:40:03 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Releasing lock "refresh_cache-b22c5688-84ed-42d3-a7cd-f139d7a77b7c" {{(pid=75095) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 16:40:03 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updated the network info_cache for instance {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 16:40:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:40:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:40:10 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG oslo_concurrency.processutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75095) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 16:40:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:40:11 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=8984MB free_disk=24.29410171508789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75095) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:40:11 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:15 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:15 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Triggering sync for uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 16:40:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:15 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:40:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75095) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75095) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 16:40:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:32 user nova-compute[75095]: INFO nova.compute.manager [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Terminating instance
Nov 15 16:40:32 user nova-compute[75095]: DEBUG nova.compute.manager [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Start destroying the instance on the hypervisor. {{(pid=75095) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-unplugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] No waiting events found dispatching network-vif-unplugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG nova.compute.manager [req-2518a6d7-321f-4fda-9789-fd0a46acf092 req-bf4f6408-5f95-4fcc-9bc4-3dab413b2a5d service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-unplugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 for instance with task_state deleting. {{(pid=75095) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:32 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Instance destroyed successfully.
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.objects.instance [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lazy-loading 'resources' on Instance uuid b22c5688-84ed-42d3-a7cd-f139d7a77b7c {{(pid=75095) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.virt.libvirt.vif [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T16:34:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2100201884',display_name='tempest-SnapshotDataIntegrityTests-server-2100201884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2100201884',id=53,image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuJk1zvs4Oqn0D3M4yuzAoC9Bk167A2ePs899iMC2iRrduseQlBktjF4ai9UInG+1zCkImXJAZl/q2CdiZfIZkFnsrwOkgs6TiqLQnBaWohv56rlHC1jrTp3yhuEmVprQ==',key_name='tempest-keypair-1962988108',keypairs=<?>,launch_index=0,launched_at=2023-11-15T16:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5eabfb1b57194c498e9160eae77857aa',ramdisk_id='',reservation_id='r-9l02bmas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='42c1c869-d893-4140-8d14-8f5bfccef902',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1017312975',owner_user_name='tempest-SnapshotDataIntegrityTests-1017312975-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T16:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19726dbb76a74e689b19ff138c025eb7',uuid=b22c5688-84ed-42d3-a7cd-f139d7a77b7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converting VIF {"id": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "address": "fa:16:3e:7d:1b:d1", "network": {"id": "2ea688fc-6158-41f9-b01f-d1c397c4a8aa", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-224563027-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5eabfb1b57194c498e9160eae77857aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84b44c0f-29", "ovs_interfaceid": "84b44c0f-2900-4c8c-abd5-e0337e5f3100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.network.os_vif_util [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29') {{(pid=75095) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG os_vif [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29') {{(pid=75095) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84b44c0f-29, bridge=br-int, if_exists=True) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1c9ccee-664c-4256-b376-b47de549386d) {{(pid=75095) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:33 user nova-compute[75095]: INFO os_vif [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:1b:d1,bridge_name='br-int',has_traffic_filtering=True,id=84b44c0f-2900-4c8c-abd5-e0337e5f3100,network=Network(2ea688fc-6158-41f9-b01f-d1c397c4a8aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84b44c0f-29')
Nov 15 16:40:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Deleting instance files /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c_del
Nov 15 16:40:33 user nova-compute[75095]: INFO nova.virt.libvirt.driver [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Deletion of /opt/stack/data/nova/instances/b22c5688-84ed-42d3-a7cd-f139d7a77b7c_del complete
Nov 15 16:40:33 user nova-compute[75095]: INFO nova.compute.manager [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 15 16:40:33 user nova-compute[75095]: DEBUG oslo.service.loopingcall [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75095) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.compute.manager [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Deallocating network for instance {{(pid=75095) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] deallocate_for_instance() {{(pid=75095) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 16:40:33 user nova-compute[75095]: DEBUG nova.network.neutron [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Updating instance_info_cache with network_info: [] {{(pid=75095) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 16:40:33 user nova-compute[75095]: INFO nova.compute.manager [-] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Took 0.82 seconds to deallocate network for instance.
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-c2d6e199-09d0-463f-895f-f010ac25167b req-1ceddbea-8543-4791-9f0f-6886e84e4eb0 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-deleted-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:34 user nova-compute[75095]: INFO nova.scheduler.client.report [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Deleted allocations for instance b22c5688-84ed-42d3-a7cd-f139d7a77b7c
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-cc0e6d07-f142-400c-afb3-f4ed0e9b1e96 tempest-SnapshotDataIntegrityTests-1017312975 tempest-SnapshotDataIntegrityTests-1017312975-project-member] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.819s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] Acquiring lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] Lock "b22c5688-84ed-42d3-a7cd-f139d7a77b7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:40:34 user nova-compute[75095]: DEBUG nova.compute.manager [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] No waiting events found dispatching network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 {{(pid=75095) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 16:40:34 user nova-compute[75095]: WARNING nova.compute.manager [req-4650398e-9af0-4909-a5d9-d21455120042 req-0dee5b75-c372-4e5e-a17d-64329c6b6575 service nova] [instance: b22c5688-84ed-42d3-a7cd-f139d7a77b7c] Received unexpected event network-vif-plugged-84b44c0f-2900-4c8c-abd5-e0337e5f3100 for instance with vm_state deleted and task_state None.
Nov 15 16:40:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:53 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:40:56 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:40:58 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:40:58 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:03 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:03 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:04 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Starting heal instance info cache {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 16:41:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Rebuilding the list of instances to heal {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 16:41:04 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Didn't find any instances for network info cache update. {{(pid=75095) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 16:41:06 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:08 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:41:08 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:08 user nova-compute[75095]: DEBUG nova.compute.manager [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75095) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 16:41:11 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:12 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:41:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:41:12 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:41:12 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Auditing locally available compute resources for user (node: user) {{(pid=75095) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:41:13 user nova-compute[75095]: WARNING nova.virt.libvirt.driver [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Hypervisor/Node resource view: name=user free_ram=9154MB free_disk=24.321212768554688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75095) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75095) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.compute.provider_tree [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed in ProviderTree for provider: 7d24b3e3-8fc8-4e80-977a-b249dde4779c {{(pid=75095) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.scheduler.client.report [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Inventory has not changed for provider 7d24b3e3-8fc8-4e80-977a-b249dde4779c based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75095) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG nova.compute.resource_tracker [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Compute_service record updated for user:user {{(pid=75095) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 16:41:13 user nova-compute[75095]: DEBUG oslo_concurrency.lockutils [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75095) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 16:41:18 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:41:21 user nova-compute[75095]: DEBUG oslo_service.periodic_task [None req-0683d198-4370-4dd7-ac8e-2dbe770a2428 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75095) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 16:41:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:23 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:26 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:28 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:29 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:33 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:38 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 16:41:43 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 16:41:48 user nova-compute[75095]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75095) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}